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Bernhard Riemann (1826-1866), the German mathematical genius whose integral is the subject of 
this book (AIP Emilio Segré Visual Archives, T. J. J. See Collection) 


This book is dedicated to all who, when they read the 
following line from John le Carré’ s 1989 Cold War 
spy novel The Russia House, immediately know they 
have encountered a most interesting character: 


“Even when he didn’t follow what he was 
looking at, he could relish a good page of 


mathematics all day long.” 


as well as to all who understand how frustrating is the 
lament in Anthony Zee’s book Quantum Field 
Theory in a Nutshell: 


“Ah, if we could only do the integral .... But we can’t.” 
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“The integral of z squared dz 
From one to the cube root of three 
All times the cosine 
Of three pi o’er nine 
Equals the natural log of the cube root of e” 


— Three classic integral jokes beloved by that curious band 
of people who, if given the choice between struggling 
with a good math problem or doing just about anything 
else, would think the decision to be obvious 


In support of the theoretical calculations performed in this book, numerical 
‘confirmations’ are provided by using several of the integration commands 
available in software packages developed by The MathWorks, Inc. of Natick, 
MA. Specifically, MATLAB® 8.1 (Release 2013a), and Symbolic Math 
Toolbox 5.10, with both packages running on a Windows 7 PC. This version 
of MATLAB® is now several releases old, but all the commands used in this 


book work with the newer versions, and are likely to continue to work for 


subsequent versions for several years more. MATLAB® is the registered 


trademark of The MathWorks, Inc. The MathWorks, Inc. does not warrant 
the accuracy of the text in this book. This book’s use or discussion of 
MATLAB® and of the Symbolic Math Toolbox does not constitute an 
endorsement or sponsorship by The MathWorks, Inc. of a particular 
pedagogical approach or particular use of the MATLAB® and the Symbolic 


Math Toolbox software. 
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Preface 


Engineering is like dancing; you don’t learn it in a darkened 
lecture hall watching slides: you learn it by getting out on the 
dance floor and having your toes stepped on. 

—Professor Jack Alford (1920-2006), cofounder of the Engi- 
neering Clinic at Harvey Mudd College, who hired the author in 
1971 as an assistant professor. The same can be said for doing 
definite integrals. 


To really appreciate this book, one dedicated to the arcane art of calculating 
definite integrals, it is necessary (although perhaps it is not sufficient) that you be 
the sort of person who finds the following question fascinating, one right up there in 
a fierce battle with a hot cup of coffee and a sugar donut for first place on the list of 
sinful pleasures: 

without actually calculating x, show that 

if x + += 1 it then follows that x’+ 45 = 1. 

Okay, I know what many (but, I hope, not you) are thinking at being confronted 
with a question like this: of what Earthly significance could such a problem possibly 
have? Well, none as far as I know, but its fascination (or not) for you provides 
(I think) excellent psychological insight into whether or not you should spend time 
and/or good money on this book. If the problem leaves someone confused, puzzled, 
or indifferent (maybe all three) then my advice to them would be to put this book 
down and to look instead for a good mystery novel, the latest Lincoln biography 
(there seems to be a new one every year—what could possibly be left unsaid?), or 
perhaps a vegetarian cookbook. 

But, if your pen is already out and scrawled pages of calculations are beginning 
to pile-up on your desk, then by gosh you are just the sort of person for whom I 
wrote this book. (If, after valiant effort you are still stumped but nonetheless just 
have to see how to do it—or if your pen simply ran dry—an analysis is provided at 
the end of the book.) More specifically, ve written with three distinct types of 
readers in mind: (1) physics/engineering/math students in their undergraduate 
years; (2) professors looking for interesting lecture material; and (3) nonacademic 
professionals looking for a “good technical read.’ 


xi 


xii Preface 


There are two possible concerns associated with calculating definite integrals 
that we should address with no delay. First, do real mathematicians actually do that 
sort of thing? Isn’t mere computation the dirty business (best done out of sight, in 
the shadows of back-alleys so as not to irreparably damage the young minds of 
impressionable youths) of grease-covered engineers with leaky pens in their shirts, 
or of geeky physicists in rumbled pants and chalk dust on their noses? Isn’t it in the 
deep, clear ocean of analytical proofs and theorems where we find real mathema- 
ticians, swimming like powerful, sleek seals? As an engineer, myself, I find that 
attitude just a bit elitist, and so Iam pleased to point to the pleasure in computation 
that many of the great mathematicians enjoyed, from Newton to the present day. 

Let me give you two examples of that. First, the reputation of the greatest 
English mathematician of the first half of the twentieth century, G.H. Hardy 
(1877-1947), partially rests on his phenomenal skill at doing definite integrals. 
(Hardy appears in numerous places in this book.) And second, the hero of this book 
(Riemann) is best known today for (besides his integral) his formulation of the 
greatest unsolved problem in mathematics, about which I’ll tell you lots more at the 
end of the book. But after his death, when his private notes on that very problem 
were studied, it was found that imbedded in all the deep theoretical stuff was a 
calculation of J2. To 38 decimal places! 

The other concern I occasionally hear strikes me as just plain crazy; the 
complaint that there is no end to definite integrals. (This should, instead, be a 
cause for joy.) You can fiddle with integrands, and with upper and lower limits, in 
an uncountable infinity of ways,’ goes the grumbling, so what’s the point of 
calculating definite integrals since you can’t possibly do them all? I hope writing 
this concern out in words is sufficient to make clear its ludicrous nature. We can 
never do all possible definite integrals, so why bother doing any? Well, what’s 
next—you can’t possibly add together all possible pairs of the real numbers, so why 
bother learning to add? Like I said—that’s nuts! 

What makes doing the specific integrals in this book of value aren’t the specific 
answers we’ll obtain, but rather the tricks (excuse me, the methods) we’ll use in 
obtaining those answers; methods you may be able to use in evaluating the integrals 
you will encounter in the future in your own work. Many of the integrals I’ll show 
you do have important uses in mathematical physics and engineering, but others are 
included just because they look, at first sight, to be so damn tough that it’s a real 
kick to see how they simply crumble away when attacked with the right trick. 

From the above you’ve probably gathered that I’ve written this book in a light- 
hearted manner (that’s code for ‘this is not a rigorous math textbook’). I am not 
going to be terribly concerned, for example, with proving the uniform convergence 
of anything, and if you don’t know what that means don’t worry about it because 
I’m not going to worry about it, either. It’s not that issues of rigor aren’t 


"You'll see, in the next chapter, that with a suitable change of variable we can transform any 
integral into an integral from 0 to oo, or from | to 00, or from 0 to 1. So things aren’t quite so bad as 
I’ve made them out. 
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important—they are—but not for us, here. When, after grinding through a long, 
convoluted sequence of manipulations to arrive at what we think is the value for 
some definite integral, I'll then simply unleash a wonderful MATLAB numerical 
integration command (quad)—short for quadrature—and we'll calculate the value. 
If our theoretical answer says it’s \/m = 1.772453... and quad says it’s — 9.3, we’ ll 
of course suspect that somewhere in all our calculations we just maybe fell off a 
cliff! If, however, guad says it is 1.77246, well then, that’s good enough for me and 
on we’ll go, happy with success and flushed with pleasure, to the next problem. 

Having said that, I would be less than honest if I don’t admit, right now, that such 
happiness could be delusional. Consider, for example, the following counter- 
example to this book’s operational philosophy. Suppose you have used a computer 
software package to show the following: 


| cos (x) Sin) gy = 1.57079632679 ..., 
0 


Pa x) sin (4x) 
. dx =1. 2679... 
| cos (x) cos 6) 5 dx = 1.57079632679...., 


ee x x) sin (4x) 
dx = 1.57079632679..., 
| cos (x) cos (5) cos (3) - Xx 


and so on, all the way out to 


ia cos (x) cos 6) cos () ... COS (55) sins) dx = 1.57079632679.... 


One would have to be blind (as well as totally lacking in imagination) not to 
immediately suspect two things: 


the consistent value of 1.57079... .is actually a (1) 


and 


ie {TT (Z) a dx = ; for all n. (2) 


This is exciting! But then you run the very next case, with n=31, and the 
computer returns an answer of 


ie cos (x) cos () cos () ... COS (55) cos (=) = dx = 1.57079632533.... 
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In this book I would dismiss the deviation (notice those last three digits!) as 
round-off error—and I would be wrong! It’s not round-off error and, despite the 
highly suggestive numerical computations, the supposed identity “for all n” is 
simply not true. It’s ‘almost’ true, but in math ‘almost’ doesn’t cut-it.* 

That’s the sort of nightmarish thing that makes mathematicians feel obligated to 
clearly state any assumptions they make and, if they be really pure, to show that 
these assumptions are valid before going forward with an analysis. I will not be so 
constrained here and, despite the previous example of how badly things can go 
wrong, I’ll assume just about anything that’s convenient at the moment (short of 
something really absurd, like 1+ 1 =3), deferring the moment of truth to when we 
‘check’ a theoretical result with MATLAB. A true mathematician would feel shame 
(perhaps even thinking that a state of moral degeneracy had been entered) if they 
should adopt such a cavalier attitude. I, on the other hand, will be immune to such 
soul-crushing doubts. Still, remain aware that we will be taking some risks. 

So I will admit, again, that violation of one or more of the conditions that 
rigorous analyses have established can lead to disaster. Additional humorous 
examples of this disconcerting event can be found in a paper® by a mathematician 
with a sense of humor. The paper opens with this provocative line: “Browsing 
through an integral table on a dull Sunday afternoon [don’t you often do the very 
same thing?] some time ago, I came across four divergent trigonometric integrals. I 
wondered how those divergent integrals [with incorrect finite values] ended up ina 
respectable table.” A couple of sentences later the author writes “We have no intent 
to defame either the well-known mathematician who made the original error [the 
rightfully famous French genius Augustin-Louis Cauchy (1789-1857) that you'll 
get to know when we get to contour integration], or the editors of the otherwise fine 
tables in which the integrals appear. We all make mistakes and we’re not out to 
point the finger at anyone ...” 

And if we do fall off a cliff, well, so what? Nobody need know. We’ ll just quietly 
gather-up our pages of faulty analysis, rip them into pieces, and toss the whole 
rotten mess into the fireplace. Our mathematical sins will be just between us and 
God (who is well known for being forgiving). 

Avoiding a computer is not necessarily a help, however. Here’s a specific 
example of what I mean by that. In a classic of its genre,’ Murray Spiegel 
(late professor of mathematics at Rensselaer Polytechnic Institute) asks readers to 
show that 


? For an informative discussion of the fascinating mathematics behind these calculations, see Nick 
Lord, “An Amusing Sequence of Trigonometrical Integrals,” The Mathematical Gazette, July 
2007, pp. 281-285. 

3 Erik Talvila, “Some Divergent Trigonometric Integrals,” The American Mathematical Monthly, 
May 2001, pp. 432-436. 

4M. R. Spiegel, Outline of Theory and Problems of Complex Variables with an Introduction to 
Conformal Mapping and Its Applications, Schaum 1964, p. 198 (problem 91). 
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which equals 1.088793 .... One can only wonder at how many students struggled 
(and for how long) to do this, as the given answer is incorrect. Later in this book, in 
(5.1.3), we'll do this integral correctly, but a use of quad (not available to Spiegel 
in 1964) quickly shows the numerical value is actually the significantly greater 
1.4603.... At the end of this Preface I'll show you two examples (including 
Spiegel’s integral) of this helpful use of quad. 

Our use of quad does prompt the question of why, if we can always calculate the 
value of any definite integral to as many decimal digits we wish, do we even care 
about finding exact expressions for these integrals? This is really a philosophical 
issue, and I think it gets to the mysterious interconnectedness of mathematics—how 
seemingly unrelated concepts can turnout to actually be intimately related. The 
expressions we’ ll find for many of the definite integrals evaluated in this book will 
involve such familiar numbers as In(2) and z, and other numbers that are not so well 
known, like Catalan’s constant (usually written as G) after the French mathemati- 
cian Eugéne Catalan (1814-1894). The common thread that stitches these and other 
numbers together is that all can be written as infinite series that can, in turn, be 
written as definite integrals: 


1 


tt 44 2x 
0 
” i 0 4 1 
=1 ae dx = 0.785398... 
4 375 719 lane i 
0 
ag a a =| In) ax = 0.9159655 
7 3 5 7 92 a ; (ee xX =U. ‘ais 


And surely it is understanding at a far deeper level to know that the famous 
Fresnel integrals ie cos(x”)dx and ie sin(x”)dx are exactly equal to 5 5, com- 
pared to knowing only that they are ‘pretty near’ 0.6267. 

In 2004 a wonderful book, very much like this one in spirit, was published by 
two mathematicians, and so I hope my cavalier words will appear to be appalling 
ones only to the most rigid of hard-core purists. That book, /rresistible Integrals 
(Cambridge University Press) by the late George Boras, and Victor Moll at Tulane 
University, is not quite as willing as this one is to return to the devil-may-care, 
eighteenth century mathematics of Euler’s day, but I strongly suspect the authors 
were often tempted. Their subtitle gave them away: Symbolics, Analysis and 
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Experiments [particularly notice this word!] in the Evaluation of Integrals. Being 
mathematicians, their technical will-power was stronger than is my puny electrical 
engineer’s dedication to rigor, but every now and then even they could not totally 
suppress their sheer pleasure at doing definite integrals. 

And then 3 years later, in another book coauthored by Moll, we find a statement 
of philosophy that exactly mirrors my own (and that of this book): “Given an 
interesting identity buried in a long and complicated paper on an unfamiliar subject, 
which would give you more confidence in its correctness: staring at the proof, or 
confirming computationally that it is correct to 10,000 decimal places?” That book 
and Irresistible Integrals are really fun math books to read. 

Irresistible Integrals is different from this one, though, in that Boras and Moll 
wrote for a more mathematically sophisticated audience than I have, assuming a 
level of knowledge equivalent to that of a junior/senior college math major. They 
also use Mathematica much more than I ure MATLAB. I, on the other hand, have 
assumed far less, just what a good student would know—with one BIG exception— 
after the first year of high school AP calculus, plus just a bit of exposure to the 
concept of a differential equation. That big exception is contour integration, which 
Boras and Moll avoided in their book because “not all [math majors] (we fear, few) 
study complex analysis.” 

Now that, I have to say, caught me by surprise. For a modern undergraduate 
math major not to have ever had a course in complex analysis seems to me to be 
shocking. As an electrical engineering major, 50 years ago, I took complex analysis 
up through contour integration (from Stanford’s math department) at the start of my 
junior year using R.V. Churchill’s famous book Complex Variables and Applica- 
tions. (I still have my beat-up, coffee-stained copy.) I think contour integration is 
just too beautiful and powerful to be left out of this book but, recognizing that my 
assumed reader may not have prior knowledge of complex analysis, all the integrals 
done in this book by contour integration are gathered together in their own chapter 
at the end of the book. Further, in that chapter I’ve included a ‘crash mini-course’ in 
the theoretical complex analysis required to understand the technique (assuming 
only that the reader has already encountered complex numbers and _ their 
manipulation). 

Irresistible Integrals contains many beautiful results, but a significant fraction of 
them is presented mostly as ‘sketches,’ with the derivation details (often presenting 
substantial challenges) left up to the reader. In this book every result is fully derived. 
Indeed, there are results here that are not in the Boras and Moll book, such as the 
famous integral first worked out in 1697 by the Swiss mathematician John Bernoulli 
(1667-1748), a result that so fascinated him he called it his “series mirabili” 
(“marvelous series’’): 


> Experimental Mathematics in Action, A. K. Peters 2007, pp. 4-5. Our calculations here with quad 
won’t be to 10,000 decimal places, but the idea is the same. 
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1 

1 1 1 1 
x* dx = 1 + + ... = 0.78343... 
| 9? 33 44 5 
or its variant 

} Edt, 

[ xtax=1+ aa oa gt... = 1.29128.... 
0 2 3 4 5 


Also derived here are the equally exotic integrals 


fe dx = | ! : A z = 0.89648 
x x= t t 0 aii 
6 32 53 7 9° 


and 


1 2 pA 2 3 2 4 2 5 
| wtac=1 (3) (7) (5) +(3) ... = 0.65858... 
0 


I don’t believe either of these last two integrals has appeared in any book 
before now. 

One famous integral that is also not in Irresistible Integrals is particularly 
interesting, in that it seemingly (I'll explain this in just a bit) owed its evaluation 
to a mathematician at Tulane University, Professor Moll’s home institution. The 
then head of Tulane’s math department, Professor Herbert Buchanan (1881-1974), 
opened a 1936 paper® with the following words: “In the consideration of a research 
problem in quantum mechanics, Professor J.C. Morris of Princeton University 
recently encountered the integral 


OO 3 
1=| we dx. 
0 ex — 1 


Since the integral does not yield to any ordinary methods of attack, Professor 
Morris asked the author to evaluate it [Joseph Chandler Morris (1902-1970) was a 
graduate of Tulane who did his PhD in physics at Princeton; later he was head of the 
physics department, and then a Vice-President, at Tulane].” Professor Buchanan 
then showed that the integral is equal to an infinite series that sums to 6.49... , and 
just after arriving at that value he wrote “It had been found from other consider- 
ations [the details of which are not mentioned, but which I’m guessing were the 
results of either numerical calculations or even, perhaps, of physics experiments 


°H. E. Buchanan, “On a Certain Integral Arising in Quantum Mechanics,” National Mathematics 
Magazine, April 1936, pp. 247-248. I treated this integral, in a way different from Buchanan, in 
my book Mrs. Perkins’s Electric Quilt, Princeton 2009, pp. 100-102, and in Chap. 5 we’ll derive it 
in yet a different way, as a special case of (5.3.4). 
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done at Princeton by Morris] that the integral should have a value between 6.3 and 
6.9. Thus the value above [6.4939...= *] furnishes a theoretical verification of 
experimental results.” 

So here we have an important definite integral apparently ‘discovered’ by a 
physicist and solved by a mathematician. In fact, as you'll learn in Chap. 5, 
Buchanan was not the first to do this integral; it had been evaluated by Riemann 
in 1859, long before 1936. Nonetheless, this is a nice illustration of the fruitful 
coexistence and positive interaction of experiment and theory, and it is perfectly 
aligned with the approach I took while writing this book. 

There is one more way this book differs from Irresistible Integrals, that reflects 
my background as an engineer rather than as a professional mathematician. I have, 
all through the book, made an effort to bring into many of the discussions a variety 
of physical applications, from such diverse fields as radio theory and theoretical 
mechanics. In all such cases, however, math plays a central role. So, for example, 
when the topic of elliptic integrals comes up (at the end of Chap. 6), I do so in the 
context of a famous physics problem. The origin of that problem is due, however, 
not to a physicist but to a nineteenth century mathematician. 

Let me close this Preface on the same note that opened it. Despite all the math in 
it, this book has been written in the spirit of ‘let’s have fun.’ That’s the same attitude 
Hardy had when, in 1926, he replied to a plea for help from a young undergraduate 
at Trinity College, Cambridge. That year, while he was still a teenager, 
H.S.M. Coxeter (1907-2003) had undertaken a study of various four-dimensional 
shapes. His investigations had suggested to him (“by a geometrical consideration 
and verified graphically”) several quite spectacular definite integrals, like’ 


/2 2 
| cos ~! cos (x) dx = oa 
0 1 + 2cos (x) 24 


In a letter to the Mathematical Gazette he asked if any reader of the journal could 
show him how to derive such an integral (we'll calculate the above so-called 
Coxeter’s integral later, in the longest derivation in this book). Coxeter went on 
to become one of the world’s great geometers and, as he wrote decades later in the 
Preface to his 1968 book Twelve Geometric Essays, “I can still recall the thrill of 
receiving [solutions from Hardy] during my second month as a freshman at 
Cambridge.” Accompanying Hardy’s solutions was a note scribbled in a margin 


7™MATLAB’s quad says this integral is 2.0561677..., which agrees quite nicely with 
sm = 2.0561675 ... . The code syntax is: quad(@(x)acos(cos(x)./U + 2*cos(x))),0,pi/2). 

For the integral I showed you earlier, from Spiegel’s book, the quad code is (I’ve used 1e6 = 10° 
for the upper limit of infinity): gquad(@(x)log( +. x)./U +x.42),0,1e6). Most of the integrals in this 
book are one-dimensional but, for those times that we will encounter higher dimensional integrals 
there is dblquad and triplequad, and MATLAB’s companion, the Symbolic Math Toolbox and its 
command int (for ‘integrate’), can do them, too. The syntax for those cases will be explained when 
we first encounter multidimensional integrals. 
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declaring that “I tried very hard not to spend time on your integrals, but to me the 
challenge of a definite integral is irresistible.”® 

If you share Hardy’s (and my) fascination for definite integrals, then this is a 
book for you. Still, despite my admiration for Hardy’s near magical talent for 
integrals, I don’t think he was always correct. I write that nearly blasphemous 
statement because, in addition to Boras and Moll, another bountiful source of 
integrals is A Treatise on the Integral Calculus, a massive two-volume work of 
nearly 1,900 pages by the English educator Joseph Edwards (1854-1931). Although 
now long out-of-print, both volumes are on the Web as Google scans and available 
for free download. In an April 1922 review in Nature that stops just short of being a 
sneer, Hardy made it quite clear that he did not like Edwards’ work (“Mr. 
Edwards’s book may serve to remind us that the early nineteenth century is not 
yet dead,” and “it cannot be treated as a serious contribution to analysis’’). Finally 
admitting that there is some good in the book, even then Hardy couldn’t resist 
tossing a cream pie in Edwards’ face with his last sentence: “The book, in short, 
may be useful to a sufficiently sophisticated teacher, provided he is careful not to 
allow it to pass into his pupil’s hands.” Well, I disagree. I found Edwards’ Treatise 
to be a terrific read, a treasure chest absolutely stuffed with mathematical gems. 

You'll find some of them in this book. Also included are dozens of challenge 
problems, with complete, detailed solutions at the back of the book if you get stuck. 
Enjoy! 


Durham, NH Paul J. Nahin 


8 And so we see where Boras and Moll got the title of their book. Several years ago, in my book Dr. 
Euler’s Fabulous Formula (Princeton 2006, 2011), I gave another example of Hardy’s fascination 
with definite integrals: see that book’s Section 5.7, “Hardy and Schuster, and their optical 
integral,” pp. 263-274. There I wrote “displaying an unevaluated definite integral to Hardy was 
very much like waving a red flag in front of a bull.” Later in this book I'll show you a ‘first 
principles’ derivation of the optical integral (Hardy’s far more sophisticated derivation uses 
Fourier transforms). 
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Chapter 1 
Introduction 


1.1 The Riemann Integral 


The immediate point of this opening section is to address the question of whether 
you will be able to understand the technical commentary in the book. To be blunt, 
do you know what an integral is? You can safely skip the next few paragraphs if this 
proves to be old hat, but perhaps it will be a useful over-view for some. It’s far less 
rigorous than a pure mathematician would like, and my intent is simply to define 
terminology. 

If y= f(x) is some (any) ‘sufficiently well-behaved’ function (if you can draw it, 
then for us it is ‘sufficiently well-behaved’) then the definite integral of f(x), as x 
varies from x = a to x = b >a, is the area (a definite number, completely determined 
by a, b, and f(x)) bounded by the function f(x) and the x-axis. It is, in fact, the 
shaded area shown in Fig. 1.1.1. That’s why you’ll often see the phrase “area under 
the curve’ in this and in other books on integrals. (We’ll deal mostly with real- 
valued functions in this book, but there will be, towards the end, a fair amount of 
discussion dealing with complex-valued functions as well). In the figure ’ ve shown 
f(x) as crossing the x-axis at x =c; area above the x-axis (from x =a to x =C) is 
positive area, while area below the x-axis (from x =c to x =b) is negative area. 

We write this so-called Riemann inte gral—after the genius German mathematician 

Bernhard Riemann (1826—1866)—in mathematical notation as J 2foddx, where 
the elongated s (that’s what the integral sign is!) stands for summation. It is worth 
taking a look at how the Riemann integral is constructed, because not all functions 
have a Riemann integral (these are functions that are not ‘well-behaved’). I'l] show 
you such a function in Sect. 1.3. Riemann’s ideas date from an 1854 paper. 

Summation comes into play because the integral is actually the limiting value of 
an infinite number of terms in a sum. Here’s how that happens. To calculate the area 
under a curve we imagine the integration interval on the x-axis, from a to b, is 
divided into n sub-intervals, with the i-th sub-interval having length Ax;. That is, if 
the end-points of the sub-intervals are 
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Fig. 1.1.1 The Riemann 
definite integral sefoodx 


a= Xo < Xj < Xo Se SK] SKS SX MX, =D 


then 


Ax; = Xi — Xji-1,1 <i<n. 


If we make the sub-intervals of equal length then 


which says 


b-—a 
ra 


Ax; = Ax = 


We imagine that, for now, n is some finite (but ‘large’) integer which means that 
Ax is ‘small.’ 

Indeed, we imagine that Ax is sufficiently small that f(x), from the beginning to 
the end of any given sub-interval, changes only slightly over the entire sub-interval. 
Let ¢; be any value of x in the interval x;_ | <¢;<x;. Then, the area bounded by 
f(x) over that sub-interval is just the area of a very thin, vertical rectangle of height 
f(¢;) and horizontal width Ax, that is, an area of f(¢;)Ax. (The shaded vertical strip 
in Fig. 1.1.2.) If we add all these rectangular areas, from x = a to x= b, we will geta 
very good approximation to the total area under the curve from x=a to x=b, 
an approximation that gets better and better as we let n— oo and so Ax—0 
(the individual rectangular areas become thinner and thinner). That is, the value 
of the integral, I, is given by 


b 


Isla, >) TCjAx= | f(x) dx 


a 


where the summation symbol has become the integral symbol and Ax has become 
the differential dx. We call f(x) the integrand of the integral, with a and b the lower 
and upper integration limits, respectively. 
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Fig. 1.1.2. Approximating Lx) 
the ‘area under the curve’ 


£(%:) 


If a and b are both finite (- co <a<b< ow), it is worth noting that we can 
always write the definite integral fPfo dx as a definite integral [ §°g(t) dt. That is, 
we can normalize the integration interval. Simply make the change of variable 
t = (=. Ifa and b are not both finite, there is always still some change of variable 
that normalizes the integration interval. For example, suppose we have { ~, f(x) dx. 
Write this as [Po tedx + | etes) dx and make the change of variable t=— x in 
the first integral. Notice, too, that the integral [ §° can always be rewritten in the 
form fj by writing { ¢° = [+f %° . and then changing variable in the last integral 
toy = + which changes the limits to 0 and 1 on that integral, too. Now, having noted 
this, for the rest of this book I’ll not bother with normalization. 

We can write 


I= [r09 dx = io du 


a a 


since the symbol we use to label the horizontal axis is x only because of tradition. 
Labeling it u makes no difference in the numerical value of I. We call the 
integration variable the dummy variable of integration. Suppose that we use u as 
the dummy variable, and replace the upper limit on the integral with the variable x 
and the lower limit with minus infinity. Now we no longer have a definite integral 
with a specific numerical value, but rather a function of x. That is, 


and our original definite integral is given by 
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What’s the relationship between F(x) and f(x)? Well, recall that from the 
definition of a derivative we have 


x+Ax x 
- PEND 8 - ie f(u) du — ix f(u) du 
dx = UMax—0 Ax = HMaAx—0 Ax 
x+Ax 
li 7 aa) f(x)Ax £(x) 
= HMax-— — = X), 
ae Ax Ax 


where the last line follows because f(x) is essentially a constant over an integration 
interval of length Ax. Integration and differentiation are each the inverse operation 
of the other. Since the derivative of any constant C is zero, we write the so-called 
indefinite integral (an integral with no upper and lower limits) as 


F(x) +C= | foods. 


So, one way to do integrals is to simply find an F(x) that, when differentiated, 
gives the integrand f(x). This is called ‘look it up in a table’ and it is a great way to 
do integrals when you have a table that has the entry you need. 

What do you do when there is no such entry available? Well, that is when matters 
become ‘interesting’! You’ll have to either get a more extensive table of F(x) < f(x) 
pairs, or work out F(x) for yourself. Or, perhaps, you’ll grudgingly have to accept 
the fact that maybe, for the particular f(x) you have, there simply is no F(x). 
Amazingly, though, it can happen in that last case that while there is no F(x) 
there may still be a computable expression to the definite integral for specific values 


x 


of the integration limits. For example, there is no F(x) for f(x) = e~ *, and all we 


can write for the indefinite integral is the admission 
zy 
e* dx=? 
and yet (as will be shown later in this book), we can still write the definite integral 


= 1 
| e* dx = 5 Ve 


0 


This is about as close to a miracle as you’ll get in mathematics. 
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MIRACLE oy 
_ OCCURS es 


“| Tak YoU SOLD BE 
MORE EXPLICIT HERE IN STEP Two.” 


Drawing by arrangement with Sidney Harris, ScienceCartoonsPlus.com 


1.2. An Example of Riemann Integration 


Here’s a pretty little calculation that nicely demonstrates the area interpretation of 
the Riemann integral. Consider the collection of all points (x, y) that, together, are 
the points in that region R of the x,y-plane where |x| +|y|< 1, where —1<x<l. 
What’s the area of R? Solving for y gives 


lyi<1—|| 
which is a condensed version of the double inequality 
=> R= ys ys DSS oe 


Let’s consider the cases of x > 0 and x <0 separately. 


Case 1: if x > 0 then |x| =x and the double inequality becomes 
(Sa yos yo larS yi 


and the area for the x > 0 portion of R is 
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[o-me=[ ta-+0-aar=| (2 — 2x) dx 


0 


Case 2: if x <0 then |x| =— x and the double inequality becomes 
-—(l+x)=y.<y<1l+x=y, 


and the area for the x <0 portion of R is 


[ (Yi — Yo) dx = [ 


La +x)+(1+x)} ax=[ (2 + 2x) dx 


= (2x+x2)|?, =2-1=1. 
So, the total area of R is 2. 
Notice that we did the entire calculation without any concern about the shape of 
R. So, what does R look like? If we knew that, then maybe the area would be 
obvious (it will be!). For x >0 we have 
ly] < 1 — |x| 
which says that one edge of R is 
y,(x) =1—x, x>0 
and another edge of R is 
yp(x) = -—1 —x) =—-1+x, x>0. 
For x < 0 we have 
|x| + ly <l 
or, as |x| = — x for x <0, 
ly] < 14x. 
Thus, a third edge of R is 
y.(x) =1+x, x <0 


and a fourth edge of R is 
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Fig. 1.2.1 The shaded, 
rotated square is R 


ya(x) = -(1 +x) =-1l-x, x<0O. 


Figure 1.2.1 shows these four edges plotted, and we see that R is a rotated 
(through 45 ) square centered on the origin, with a side length of 2. That is, it has 
an area of 2, just as we calculated with the Riemann integral. 


1.3. The Lebesgue Integral 


Now, in the interest of honesty for the engineers reading this (and to avoid scornful 
denunciation by the mathematicians reading this!), I must take a time-out here and 
tell you that the Riemann integral (and its area interpretation) is not the end of the 
line when it comes to integration. In 1902 the French mathematician Henri 
Lebesgue (1875-1941) extended the Riemann integral to be able to handle inte- 
grand functions that, in no obvious way, bound an area. There are such functions; 
probably the most famous is the one cooked-up in 1829 by the German mathema- 
tician Lejeune Dirichlet (1805-1859): 


i 0 when x is irrational 


Try drawing a sketch of d(x)—and I'll bet you can’t! In any interval of finite 
length there are an infinity of rationals and irrationals, each, and Dirichlet’s 
function is a very busy one, jumping wildly back-and-forth an infinity of times 
between 0 and | like an over-caffeinated frog on a sugar-high. (That the rationals 
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Fig. 1.3.1 Riemann’s weird function 


are a countable infinity and the irrationals are an uncountable infinity are two 
famous results in mathematics, both due to the Russian-born German mathemati- 
cian Georg Cantor (1845—1918).) And if you can’t even draw it, how can you talk of 
Dirichlet’s function as ‘bounding an area’? You can’t, and Dirichlet’s function is an 
example of a function that isn’t integrable in the Riemann sense. 

You might suspect that it is the infinite number of discontinuous jumps within a 
finite interval that makes (x) non-Riemann integrable, but in fact it possible to 
have a similarly wildly discontinuous function that remains Riemann integrable. 
Indeed, in 1854 Riemann himself created such a function. Define [x] as the integer 
nearest to x. For example, [9.8] = 10 and [—10.9] = — 11. If x is exactly between 
two integers, then [x] is defined to be zero; [3.5] =0. Riemann’s infinitely discon- 
tinuous function is then 


)= ye 


In Fig. 1.3.1 I’ve plotted an approximation (using the first eight terms of the 
sum) to r(x) over the interval 0-1. That figure will, I think, just start to give you a 
sense of just how crazy-wild r(x) is; it has an infinite number of discontinuities in 
the interval 0-1, and yet Riemann showed that r(x) is still integrable in the Riemann 
sense even while (x) is not.! 


' For more on r(x), see E. Hairer and G. Wanner, Analysis by Its History, Springer 1996, p. 232, and 
William Dunham, The Calculus Gallery, Princeton 2005, pp. 108-112. 
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But Dirichlet’s function is integrable in the Lebesgue sense. Rather than 
sub-dividing the integration interval into sub-intervals as in the Riemann integral, 
the Lebesgue integral divides the integration interval into sets of points. Lebesgue’s 
central intellectual contribution was the introduction of the concept of the measure 
of a set. For the Riemann sub-interval, its measure was simply its length. The 
Riemann integral is thus just a special case of the Lebesgue integral, as a 
sub-interval is just one particular way to define a set of points; but there are other 
ways, too. When the Riemann integral exists, so does the Lebesgue integral, but the 
converse is not true. When both integrals exist they are equal. 

To see how this works, let’s calculate the Lebesgue integral of (x) over the 
interval 0-1. In this interval, focus first on all the rational values of x that have the 
particular integer n in the denominator of the fraction 7 (by definition, this is 
the form of a rational number). Given the n we’ve chosen, we see that m can vary 
from 0 to n, that is, there are n+ | such rational values (points) along the x-axis from 
0 to 1. Now, imagine each of these points embedded in an interval of length +, 
where e€ is an arbitrarily small (but non-zero) positive number. That means we can 
imagine as tiny an interval as we wish, as long as it has a non-zero length. The total 
length of all the n+ 1 intervals is then 


€ € € 

Remember, this is for a particular n. 

Now, sum over all possible n, that is, let n run from | to infinity. There will, of 
course, be a lot of repetition: for example, n= 2 and m= 1, and n= 26 and m= 13, 
define the same point. So, the total length of all the intervals that cover all the 
rational numbers from 0 to 1 is at most 


co «1 co «1 
pee mt ae =}. 


As is well-known, both sums have a finite value (the first is, of course, Euler’s 


famous result of 7 which will be derived in Chap. 7, and the second sum is 
obviously even smaller). The point is that the total sum in the braces has some 
finite value S, and so the total length of all the intervals that cover all the rational 
numbers from 0 to | is at most eS, and we can make this as small as we wish by just 
picking ever smaller values for e. Lebesgue says the measure of the set of all the 
rationals from 0 to | is zero and so, in the Lebesgue sense, we have 


i (x) dx =0. 


0 


Now, with all that said, I'll simultaneously admit to the beauty of the Lebesgue 
integral as well as admit to the ‘scandalous’ fact that in this book I’m not going to 


10 1 Introduction 


worry about it! In 1926 the President of the Mathematical Association (England) 
sternly stated “To be a serious mathematician and not to use the Lebesgue integral 
is to adopt the attitude of the old man in a country village who refuses to travel in a 
train.”? On the other hand, the American electrical engineer and computer scientist 
Richard Hamming (1915-1998) somewhat cavalierly rebutted that when he 
declared (in a 1997 address° to mathematicians!) 


... for more than 40 years I have claimed that if whether an airplane would fly or not 
depended on whether some function that arose in its design was Lebesgue but not Riemann 
integrable, then I would not fly in it. Would you? Does Nature recognize the difference? I 
doubt it! You may, of course, choose as you please in this matter, but I have noticed that 
year by year the Lebesgue integration, and indeed all of measure theory, seems to be 
playing a smaller and smaller role in other fields of mathematics, and none at all in fields 
that merely use mathematics [my emphasis]. 


I think Hamming has the stronger position, and all the integrals you’ll see from 
now on in this book are to be understood as Riemann integrals. 

For mathematicians who might be tempted to dismiss Hamming’s words with 
“Well, what else would you expect from an engineer!,’ let me point out that the year 
before Hamming’s talk a mathematician had said essentially the same thing in a 
paper that Hamming had surely read. After admitting that the Lebesgue integral “has 
become the ‘official’ integral in mathematical research,” Robert Bartle (1927-2003) 
then stated “the time has come to discard the Lebesgue integral as the primary 
integral [Bartle’s emphasis].’”* 


1.4 ‘Interesting’ and ‘Inside’ 


So, what’s an interesting integral, and what does it mean to talk of being ‘inside’ it? 
I suppose the honest answer about the ‘interesting’ part is sort of along the lines of 
Supreme Court Associate Justice Potter Stewart’s famous 1964 comment on the 
question of “what is pornography?” He admitted it was hard to define “but I know it 
when I see it.” It’s exactly the same with an interesting integral! 

In 1957, in the summer between my junior and senior years in high school, I 
bought a copy of the second edition of George B. Thomas’ famous textbook 
Calculus and Analytic Geometry for a summer school class at the local junior 
college. I still remember the thrill I felt when, flipping through the pages for the first 


? Comment made after the presentation by E. C. Francis of his paper “Modern Theories of 
Integration,” The Mathematical Gazette, March 1926, pp. 72-77. 

In Hamming’s paper “Mathematics On a Distant Planet,” The American Mathematical Monthly, 
August-September 1998, pp. 640-650. 

“ See Bartle’s award-winning paper “Return to the Riemann Integral,” The American Mathemat- 
ical Monthly, October 1996, pp. 625-632. He was professor of mathematics at the University of 
Illinois for many years, and then at Eastern Michigan University. 
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time, I happened across (on p. 369) the following (Thomas says it’s from the “lifting 
theory” of aerodynamics): 


1 
| a dx =. 
1VvVil-x 

Why did I, a kid not yet seventeen who had only recently still been building 
model airplanes from balsa wood kits and leaky tubes of glue, find that ‘interest- 
ing’? I didn’t know then—and I’m not really sure I do even now—except that it just 
looks “mysterious and exotic.’ 

Now some may snicker at reading that, but I don’t care—by god, to me that 
aerodynamic integral still looks mysterious and exotic! It’s a line of writing as 
wonderful as anything you’ll find in Hemingway or Dostoevsky and, unlike with 
even the greatest fiction, it’s a line that nobody could just make-up. What, after all, 
does all that strange (to me, then) stuff on the left-hand-side of the equal sign have 
to do with x? I of course knew even in those long-ago days that x was intimately 
connected to circles, but I didn’t see any circles on the left. Interesting! 

This sort of emotional reaction isn’t limited to just amateur mathematicians; 
professionals can be swept-up by the same euphoria. In 1935, for example, at the 
end of his presidential address to the London Mathematical Society, the English 
mathematician G. N. Watson (1886-1965) mentioned this astonishing definite 
integral: 


eo 2n(nt1)x 


[° eno sinh(zx) oe 1 ou 
0 sinh(3mx) ———@2"/3\/3 —~n=0 (1 +e-*)?(1 + e-3")? (14 e- (2m l)n)™ 


Of it he declared that it gave him “a thrill which is indistinguishable from the 
thrill which I feel when I enter the Sagrestia Nuova of the Capelle Medicee and see 
before me the austere beauty of the four statues representing Day, Night, Evening, 
and Dawn which Michelangelo has set over the tombs of Guiliano de’ Medici and 
Lorenzo de’ Medici.” 

Wow. 

Alright, now what does being ‘inside’ an integral mean? I’1l try to answer that by 
example. Suppose I tell you that 


lin(1 
[ AES ox =F 
9 1+x? 8 


You’d probably just shrug your shoulders and say (or at least think it if too polite to 
actually say it) “Okay. Where did you get that from, a good table of integrals? Which 
one did you use? Il] look it up, too.” And so you could, but could you derive the result? 
That’s what I mean by getting ‘inside’ an integral. It’s the art of starting with the 
integral on the left side of the equal sign and somehow getting to a computable 
expression on the right side. (We'll do this integral later in the book—see (2.2.4).) 
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Tuse the word art with intent. There is no theory to doing definite integrals. Each 
new integral is a brand new challenge and each new challenge almost always 
demands a new trick or, at least, a new twist or two to a previous trick. That’s 
right, a trick. Some people might recoil in horror at that, but a real analyst simply 
smiles with anticipation at the promise of a righteous struggle. And even if the 
integral wins for the moment, leaving the analyst exhausted and with a pounding 
headache, the analyst knows that there is always tomorrow in which to try again. 


1.5 Some Examples of Tricks 


Now, just so you know what I’m talking about when I use the word trick, here’s the 
first example of a trick in this book (the rest of this book is, essentially, just one new 
trick after the next!). What goes on the right-hand side of 


1 
| cos (x) aio 
~1 e(!/x) + 1 


This integral almost surely looks pretty scary to nearly everybody at first sight; 
trying to find an F(x) that, when differentiated gives the integrand, certainly doesn’t 
seem very promising. But in fact the definite integral can be done by a first-year 
calculus student if that student sees the trick! Play around with this for a while as I 
work my way towards the stunning revelation of the answer, and see if you can beat 
me to it. 

Consider the more general integral 


——— dx 


Beers 


where d(x) is just about any function of x that you wish. (For the original integral, 
d(x) = ell! 4 I'll impose a restriction on d(x) in just a bit, but not right now. If we 
then write 


then we arrive (of course!) at the integral 


[, g(x) dx. 


No matter what g(x) is, we can always write it as the sum of an even function 
g-(x) and an odd function g,(x). That is, 
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(x) = g.(x) + go(x). 


How do we know we can do this? Because we can actually write down what 
g(x) and g,(x) are. By the definitions of even and odd we have 


@(—x) = g.(—x) + 8o(-x) = g-(x) — g0(x) 


and so it is simple algebra to arrive at 


_ g(x) + 8(—x) 
&e(x) _—* 2 
and 
2 :B(k) (=x) 
8 (X) 5 
Now, 


[. g(x) dx = i? g.(x) dx + [. g,(x) dx = [, g.(x) dx 


because by the ‘symmetry’ of an odd function around x = 0 we have (think ‘area 
under the curve’) 


fi g,(x) dx = 0. 


From our original integral, we have 


and so 


1 [ cos (x) cos (—x) 
g(x) = te 

2|d(x) +1 d(—x)4+1 
or, because cos(—x) = cos(x), that is, because the cosine is an even function, 


(x) cos (x) 1 1 | cos (x) d(—x) +1+d(x) +1 
Be 3 dG aed d(x) 2 |d(x)d(—x) + d(x) + d(—x) +1 
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or, 


cos (x) 2+ d(—x) 


d(x) 
20) => lade) a) 


d(—x) + 1] 


+ 
+ 
Okay, suppose we now put a restriction on d(x). Suppose d(x)d(—x) = 1. This is 
the case, you’ll notice, for the d(x) in our original integral (= elt ~) because 
d(x)d(—x) = e@/%e(-/) = e® = 1, 
Well, then, you should now see that the numerator and the denominator of all 


that stuff in the brackets on the right-hand-side of the last expression for g,(x) are 
equal! That is, everything in the brackets reduces to 1 and so 


' cos (x) ' cos (x) tif 1, 1 
|_ gaa dx = . dx =5| cos (x) dx = 5 {sin (x)}|_ 


_ sin (1) sm )_ sin (1) = 0.8414709....° 


Now that’s a trick! MATLAB’s quad agrees, computing a value of 0.8414623. 
The code syntax is: guad(@(x)cos(x)./(expU./x) + 1),—1,1). 

This was a fairly sophisticated trick, but sometimes even pretty low-level 
approaches can achieve ‘tricky’ successes. For example, what is the value of 


le In(x) 


dx =? 
) 1+ x? _ 


Let’s start with the obvious f{ §° = { + { 7°. In the first integral on the right, make 
the change of variable t= 1/x (and so dx = — dt/t”). Then, 


3 Writing sin(1) means, of course, the sine of 1 radian = 180" = 57.3 (not of 1 degree). 


1.5 Some Examples of Tricks 15 


fm, a= [MO (dn) -— fi Oa PP Oa 


o 1+ x? ee ee wottl Jj, #41 
° In(t 
--| mt) ae 
, t4+1 


That is, recognizing that t and x are just dummy variables of integration, we have 
Ik = — | f°. And so we immediately have our result (first derived by Euler): 


(1.5.1) 


This is, in fact, a special case of the more general integral 


[oe a 


0 b? + x2 


See if you can calculate this integral (your answer should, of course, reduce to 
zero when b = 1); if you have trouble with it we’ll evaluate this integral in the next 
chapter—in (2.1.3)—-where you’ll see that knowing the special case helps (a /or!) in 
doing the general case. 

For a third example of a trick, let me show you one that illustrates just how 
clever the early students of the calculus could be in teasing-out the value of a 
definite integral. This trick dates back to 1719, when the Italian mathematician 
Giulio Fagnano (1682-1766) calculated | Ta Today, of course, a first-year 

0 
calculus freshman would recognize the indefinite integral to be tan” '(x), and so the 
answer is tan~'(oo) — tan~'(0) = §. But Fagnano’s clever trick does not require 
knowledge of the indefinite integral,° but only how to differentiate. Here’s how 
Fagnano did it. 

Imagine a circle with radius r, centered on the origin of the xy-plane. The 
arc-length L along the circumference of that circle that is subtended by a central 
angle of 8 is L=10. Now, suppose that r= 1. Then L= 8 and so, with t as a dummy 
variable of integration, 


; F oo. 1 _1/X 
> Ax you immediately recognize it as — tan (=). 
a? + x? a a 
This is one of the few ‘fundamental’ indefinite integrals I’m going to assume you’ve seen 


°T am assuming that when you see | 


1 
previously from a first course of calculus. Others are: [=a = into), fes dx=e’, 
Xx 


n+l d 
fe dx - i (n 1), las sin ~'(x), and f In(x)dx = x In(x) — x. 
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8 
L=9=| dt. 


Fagnano then played around with this very simple integrand (indeed, how could 
it possibly be any simpler!?) to make it more complicated! Specifically, 


0G eae TH) 
=| SO a= | een t= | Sa 


9 “cos?(t) cos 2(t) 


Next, change variable to x = tan(t), which says 


Thus, 


Suppose 8 = §. Then tan (@) = tan (5) = oo, and of course L is one-fourth the 
circle’s circumference and so equals 5 because 5 is one-fourth of 27, the circumfer- 


ence of a unit radius circle. Thus, instantly, 


==|. dx 
27 0 1+ x? 


By the same reasoning, we instantly have 


z= [ dx 


4 0 1+x?’ 
and 

== |" dx 

3 0 1+ x?’ 
and 

ea [ dx 

6 Jo 14%? 


Pretty clever. 
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1.6 Singularities 


Tricks are neat, and the discovery of each new one is like the thrill you get when 
digging through a box of raisins (think ‘routine’ integration methods, good for you, 
yeah, but still sorta boring) and every now and then coming across a chocolate- 
covered peanut (think ‘fantastic new trick’). But—one does have to be ever alert for 
pitfalls that, we hope, guad will be our last-ditch defense against. Here’s an 
example of what I’m getting at, in which that most common of operations—blindly 
plugging into a standard integration formula—can lead to disaster. 


1 
d 

Suppose we have the integral I = | =e The integrand f(x) = (2) is never 
LX 


negative because it’s the square of a real value (from — | to 1). Thus, we know 
immediately, from the area interpretation of the Riemann integral, that I> 0. 
However, from differential calculus we also know that 


and so, upon integrating, we have 


= (L-C)-A)- 


That’s right, minus 2, which is certainly Jess than zero. What’s going on with 
this? 

The problem is that f(x) blows-up at x = 0, right in the middle of the integration 
interval. The integral is called improper, and x = 0 is called a singularity. You have 
to be ever alert for singularities when you are doing integrals; always, stay away 
from singularities. Singularities are the black holes of integrals; don’t “fall into’ one 
(don’t integrate across a singularity). You'll find, when we get to contour integra- 
tion, this will be very important to keep in mind. Here’s how to do that for our 
integral. We’ll write I as follows, where ¢ is an arbitrarily small, positive quantity: 


1 —€ 1 
d d d 
=| <= lim| = lim] ae 


1 x2 e0J_) xX 20). x2 
Then, 
—€ 1 
I= lim| —— + lim | —— 
e—0 x e—0 
1 1 . 1 
= lim —— |} — | —— + lim ——]}] — | —— 
e—0 —é —1 e—0 € 
1 2 
=lim| -—1—1+-] =lim|—-] —2=+0 
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The integral is (as we expected) positive—in fact, it’s infinitely positive! It 
certainly is not negative. Notice, too, that our first (incorrect) result of —2 is now 
understandable—it’s right there in the correct answer, along with the infinite 
contribution from the singularity that we originally missed. 

Now, to see if you’ve really grasped the problem with the above integral, 
consider this integral, one made famous in mathematical physics by the Nobel 
prize-winning physicist Richard Feynman (1918-1988): if a and b are real-valued, 
arbitrary constants, then 


(1.6.1) 


Do you see the issue here? If a and b have opposite algebraic signs then the right- 
hand side of the above formula is negative. But on the left-hand-side, the integrand 
is always something squared, no matter what a and b may be, and so the integrand is 
never negative. We appear to have a conflict. What’s going with this? Hint: ask 
yourself if the integrand has a singularity and, if so, where is it located?’ (See 
Challenge Problem 3 at the end of this chapter.) 

Before leaving the subject of singularities, I should tell you that there are other 
infinity concerns besides the blowing-up of the integrand that can occur when doing 
integrals. What do we mean, for example, when we write {~,f(x) dx ? The area 
interpretation of the Riemann integral can fail us in this case, even when f(x) is a 
‘nice’ function. For example, how much area is under the curve f(x)=sin(x), 
—0o<x<oo ? Since sin(x) is an odd function it seems we should be able to 
argue that there is always a piece of negative area that cancels every piece of 
positive area, and so we’d like to write 


[- sin (x)dx = 0. 


—oo 


But what then about the area under the curve f(x) = cos(x), — 00 <x < co ? Now 
we have an even function (it’s just a shifted sine function!) but we can still 
apparently make the negative/positive area cancellation argument, and so is it 
true that 


[- cos (x)dx = 2[° cos (x)dx = 0? 


That is, is it true that 


7 This integral appeared in Feynman’s famous paper “Space-Time Approach to Quantum Electro- 
dynamics,” Physical Review, September 15, 1949, pp. 769-789. Some historical discussion of the 
integral is in my book Number—Crunching, Princeton 2011, pp. xx—xxi. 
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| cos (x)dx = 0? 
0 


The answer is no, neither Nears sin(x)dx or ice cos(x)dx exist. We can, how- 
ever, write what mathematicians call the Cauchy Principal Value of the integral: 


i f(x) dx = lime ao f(x) dx, 


—oo —R 


an integral that is zero if f(x) is odd. This approach, using a symmetrical limiting 
operation, means that the Cauchy Principal Value for { °°, sin(x)dx does exist (it is 
zero), even though the integral does not. 

If, however, we have an f(x) integrand such that lim, _.+.f(x)=0 ‘fast 


enough’—that means faster than i ( for example, sm) then we don’t have 
these conceptual difficulties. But even this isn’t enough to fully capture all the 
subtle problems that can come with infinity. That’s because an integrand like f(x) = 
cos(x*), which doesn’t go to zero as x + +00, does have a definite integral over 
—0oo<x<oo (you’ll recall this integral—called a Fresnel integral—from the 
Preface). That’s because cos(x”) oscillates faster and faster between +1 as x 
increases in both directions, and so the positive and negative areas above and 
below the x-axis individually go to zero faster and faster and so contribute less 
and less to the total area under the curve (an area which is finite). 

Our little trick of “sneaking-up’ on a singularity can be quite powerful. Consider, 
for example, the interesting integral 


oo dx 
| ere 
When x is between 0 and | the integrand is negative, while when x is greater than 
1 the integrand is positive. There is obviously a singularity at x=1, with the 
integrand blowing-up to minus-infinity as x approaches 1 from values less than 
1, and blowing-up to plus-infinity as x approaches | from values greater than 1. Is it 
possible, we might wonder, for these two infinite explosions (with opposite signs) to 


perhaps cancel each other? In fact they do, and to convince you of that I'll use the 
‘sneak’ trick to write our integral as 


ITE dx co dx 
i ar ls 1 
and then explore what happens as e — 0. 

In the spirit of this book I'll first use guad to experimentally study what happens 
as e— 0. In the following table I’ve listed the result of running the following 
MATLAB command for various, ever smaller, values of ¢ (stored in the vector e(i)): 

quad(@(x)1./(x.43-1),0,1-ei)) + quad(@(x)1./(x.43-1),1 + ei),1000) 
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€ AEs” dx _{? dx 
I 1 es 
0.1 — 0.53785 
0.01 — 0.59793 
0.001 — 0.60393 
0.0001 — 0.60453 
0.00001 — 0.60459 
0.000001 — 0.60459 
0.0000001 — 0.60459 


So, from this numerical work it would appear that 


oud 
| —— = —0.60459, 
k= 1 


Well, what could this curious number be? As it turns out we can answer this 
question, exactly, because it proves possible to actually find the indefinite integral! 
That’s because we can write the integrand as the partial fraction expansion 


1 1 2x +1 1 
xe—1 3(x—1) 6(x?4+x41) 2(x*4+x+4+1) 


or, completing the square in the denominator of the last term, 


i. si 2x+1 I 
e—1 3(x-1) 6(x2+x+1) 2](x +4)? +3] 


Each of the individual terms on the right is easily integrated, giving 


dx 1 1 ee 1 _,[2x4+1 
[yagi 1) gin(x +x +1) a 63 
1 1 2x +1 
= = {2In(x — 1) — In(x? +x+1 tan! 
2 
ah (x —1) 1 poe 2x +1 
6 )x?+x+1 V3 V3 
adie x? —2x+1 1 ee 2x+ 1 
6 +x+1 V3 V3 


The argument of the log function is well-behaved for all x in the integration 
interval except at x = | where we get log(0), and so let’s again use the sneak trick, 
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but this time analytically. That is, we'll integrate from 0 to 1 — € and add it to the 
integral from 1+¢ to oo. Then we’ll let e — 0. So, noticing that the log function 
vanishes at both x = 0 and at x = oo (each give log(1)), we have 


OER) 44 1 J(1—e)?-2(1-e) +1 1 _,J2—e)4+1 
I eS im gm aah a= ao v3 


1 1 1+e) -2(1 1 
+ lim,_.9 | -— tan ~! (00) In (re) - ee 
(1+e)°+(1+e)+1 


aod oe 2(1+e)4+1 
v3 v3 ; 


The log terms expand as 


1 Jiadete?-2+2+1( 1, Jit+2ete?-2—-2H+1 
n n 
6 )l—e+e?+1—e +1( 6 )1+2e+e2+1lte +1 


1 e 1 2 1 ge -+3e +3 
= In In = In 
6 e? —3e +3 6 e2+3e +3 6 e2 —3e +3 


: tan! 2a + : tan! : : tan ~'(00) 
—— —|-—=; oo 
v3 v3 v3 v3} v3 


fll Si 2+2e +1 1 pet 3 —2e 2 1 i 1 
V3 V3 V3 V3 V3 V3 
1 [x i 1 pra 3+ 2¢ 
—|- — tan 
V3\2} v3 V3 


or, as €e — 0, this reduces to 
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So, at last, 


(1.6.2) 


which is, indeed, the curious — 0.60459. 


1.7 Dalzell’s Integral 


The rest of this book is simply a lot more tricks, some even more spectacular than 
the one I showed you in Sect. 1.5. But why, some may ask, should we study tricks? 
After all, with modern computer software even seemingly impossible integrals can 
be done far faster than a human can work. Please understand that I’m not talking 
about numerical integrators, like MATLAB’s quad (although far less rapidly, 
mathematicians could do that sort of thing centuries ago!). ’'m talking about 
symbolic integrators like, for example, the on-line (available for free) Mathematica 
symbolic integrator software that needs only a fraction of a second to evaluate the 
indefinite aerodynamic integral from earlier in this Introduction (Sect. 1.4): 


i i 
| a 2 ain-( = i 


1-x 2 


You can verify that this is indeed correct by simply differentiating the right- 
hand-side and observing the integrand on the left-hand-side appear. And when the 
lower and upper limits of —1 and +1, respectively, are plugged-in, we get 7, just as 
Professor Thomas wrote in his book. 

Now, I'd be the first to admit that there is a /ot of merit to using automatic, 
computer integrators. If / had to do a tough integral as part of a job for which I was 
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getting paid, the first thing J would do is go to Wolfram (although, I should tell you, 
Wolfram fails on the indefinite Fraser 
d(x) + 1 
our little even/odd trick—fails, almost surely, since there is no indefinite integral). 
That admission ignores the fun of doing definite integrals, however, the same sort of 
fun that so many people enjoy when they do Sudoku puzzles. Battling Sudoku 
puzzles or integrals is a combat of wits with an ‘adversary’ (the rules of math) that 
tolerates zero cheating. If you succeed at either, it ain’t luck—it’s skill. 
Now, just to show you I’m serious when I say doing definite integrals can be fun, 
consider 


dx that we solved for a definite case with 


dx, 


| tree 38 
0 1 + x? 

which first appeared (in 1944) on the pages of the Journal of the London Mathe- 
matical Society. What’s so ‘fun’ about this, you ask? Well, look at what we get 


when I is evaluated. Multiplying out the numerator, and then doing the long 
division of the result by the denominator, we get 


1 
4 
=| (x°— 405 + 5x4 42 44-4) dx, 
4) 1+ x? 


integrations that are all easily done to give 


psa x 2x0 P 4x 4 Atan-"(x) 
= LS x x an! (x 
> 1+x 7 4 3 ; 
1 2 
= 1 4 
7 37 37 1 
That is, 
(1.7.1) 


Since the integrand is never negative, we know that I>0 and so we have the 
sudden (and, I think, totally unexpected) result that 2 >. That is, the classic 
schoolboy approximation to m is an overestimate, a fact that is not so easy to 
otherwise establish. 

Our calculations actually give us more information than just ap >; we can 
also get an idea of just how good an approximation 2 is to x. That’s because if we 


replace the denominator of the integrand with 1 we’ll clearly get a bigger value for 
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the integral, while if we replace the denominator with 2 we’ll get a smaller value for 
the integral. That is, 


1 4(q 4 1 44 4 2 1 
[eo  a<] St i) dx = x<| xx)" dx 
0 


or, multiplying out, integrating, and plugging-in the limits, 


1/1_ 2,6 a eee mea Ce aS re ee 
2\5 3.7 2 9) 1,260 ~ 7 5 3 7 2 9) 630 


or, multiplying through by — | (which reverses the sense of the inequalities), 


ee eee 
630" 7 ~ 1,260 
or, at last, 
221 2 1 


7 60°" <7  4,260° 

To five decimal places, this says 3.14127 <1 < 3.14206, which nicely and fairly 
tightly bounds xz (=3.14159 .. .). Now who would deny that this sort of thing is fun?! 

The author of the 1944 paper that first published this gem was D. P. Dalzell, a 
curious fellow who is mostly a ghost in the history of mathematics. All of the 
modern references to Dalzell’s integral make no mention of the man, himself, even 
though he wrote a number of high quality mathematical papers and had an excellent 
reputation among mathematicians. Dalzell didn’t help his cause by his habit of 
always using his initials. In fact, he was Donald Percy Dalzell (1898-1988), who 
graduated in 1921 from St. John’s College, Cambridge, in mathematics and 
mechanical sciences. He received an MA degree in 1926, and his career was not 
as a mathematician but rather as a chartered engineer (a term used in England for a 
masters level professional engineer). He worked for a number of years for the 
Standard Telephones and Cables Company in London, and had two patents on 
electrical communication cables. The only known photograph of him is the one on 
the MacTutor math web-site (taken at the 1930 Edinburgh Mathematical Society 
Colloquium at St. Andrews). 


1.8 Where Integrals Come From 


Just about all of the discussions in this book are in the form of ‘here’s an integral, 
how can we evaluate it?’ Mathematicians, of course, can simply ‘make-up’ inte- 
grals off the tops of their heads, but engineers and physicists generally encounter 
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integrals resulting from the analysis of a physical problem. I thought, therefore, that 
I should include examples of that sort of origin of integrals, too, in addition to the 
pure imagination of mathematicians. Still, with each of the first two examples in 
this section I have made an effort to keep the interest of mathematicians, too, by 
selecting physical problems, each giving birth to an integral, that are mathematical 
problems at heart; both of these examples come from probability. For a third 
example of where interesting integrals ‘come from,’ I’ve selected a problem that 
I first came across while reading /rresistible Integrals, a book I mentioned in the 
Preface. I think it nicely illustrates how mathematicians can need motivation, too 
(just like physicists), for some of the ‘weird’ integrals they conjure-up! 

So, to start, here is what I call ‘The Circle in a Circle’ problem. Imagine a circle 
(let’s call it C,) that has radius a. We then chose at random,® and independently, 
three points from the interior of that circle. These three points, if non-collinear, 
uniquely determine another circle, C,. C2 may or may not be totally contained 
within C,. What is the probability that C, lies totally inside C,?° 

To answer this, imagine that after picking the three points we’ve drawn Cy, as 
shown in Fig. 1.8.1. There I’ve shown C, as totally inside C,, but that’s just because 
I arbitrarily decided to do it that way instead of showing the alternative. Without 
any loss of generality, we can further imagine that the horizontal axis passes 
through the center of Cz (as shown) because we can always rotate the figure to 
make that so. The center of C> is taken to be distance r from the center of C;, and the 
radius of C> is taken to be x. 

Next, imagine a thin, circular band of width Ax is drawn that encloses the 
circumference of C3. The area of this band is, to a first approximation that gets 
better and better as Ax — 0, given by 2mx Ax. The probability a point selected at 
random from the interior of C, is from this band is, therefore, the ratio of the area of 
the band to the area of C> (see note 8 again): 


2nx Ax 2 
oo => po Ax. 


(ll comment further on this claim, in just a bit.) Since the three points that 
determine C, all fall inside the band (by definition!), and they are independently 
selected, then the probability of that event is 


8 «At random’ has the following meaning. If we look at any tiny patch of area dA in the interior of 
C,, a patch of any shape, then the probability a point is selected from that area patch is dA divided 
by the area of C;. We say that each of the three points is selected uniformly from the interior of Cy. 
° T think it almost intuitively obvious that the probability is scale-invariant (the same for any value 
of a), but just in case it isn’t obvious for you I’1l carry the radius of C, along explicitly. At the end 
of our analysis you’ll see that the scale-setting parameter a has disappeared, proving my claim. 
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Fig. 1.8.1 A ‘Circle Inside A Circle’ 


ax = 5faxPax = 2x3AAA 
wx Ax mera x} X= GX Xx 


where AA = {Ax}? is the differential area in rectangular coordinates. (Ill elaborate 
on this claim, in just a bit.) I'll write AA and Ax as dA and dx, respectively, from 
now on. 

Obviously if x = 0 (that is, if C, is a degenerate circle that is actually a point) we 
see that C is necessarily inside C,. In fact, as x increases from 0, it can get as large 
as a—r before C, penetrates C,. So, the probability the C, circle, centered on a 
particular line (the horizontal axis), is totally within C, is 
8dA (*" , 8 dA (xt) \a-+ 2dA 

x dx = = 
a® j ao {a} 0 a® 


(=a). 
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In general, of course, the center of C, could fall anywhere inside C;, with any 
value of r from 0 to a occurring, and so we need to integrate the above differential 
probability (differential because of the dA) over the entire interior of C;. This is 
most easily done by writing dA in polar coordinates, as r dr dO, and so the 
probability we are after is 


since the 0-integral is obviously just 27 (there is no 8-dependency in the integrand). 
The remaining r-integral is easily done by making the change of variable 
u=a — r (and so du= — dr). So, 


a a 


| (a—1)*rdr= [ u‘(a — u)(—du) = | 


u‘(a — u)du = a| 
0 a 0 


a 
udu — | wdu 
0 0 


a a 


Thus, the probability that C, lies totally inside C, is 


An (a® 4n 20 
ao (5) 30. 0=«15 ates? 


Notice that the radius of C;, a, has cancelled away, which supports my earlier 
claim that the probability is scale-invariant. 

Well, all this is fine as it stands, BUT—how do we really know that one of our 
admittedly casual manipulations along the way didn’t have a hidden flaw in it?'° 
(Like the claim, for example, that {Ax}? is the differential area in rectangular 
coordinates, in which I’ve replaced the Ay in the usual dA = AxAy with another 
Ax. Or, what about the claim a randomly selected point from the interior of C, is in 
the Ax band around C3, as that assumes Cz is totally inside C,?) The integral we 
evaluated was not a technically difficult one to do, but how do we know we arrived 
at the correct integral? This is a question, often confronting the engineering analyst, 
which might not be of great concern to a pure mathematician who is simply looking 
for an ‘interesting integral.’ 


‘0 The analysis I’ve just taken you through is the one given on pp. 817-818 of Edwards’ book that I 


mentioned in the Preface. The result of # is the answer derived by Edwards. 
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When we ‘check’ integrals that are just given to us, we’ll use quad or int, but 
when we are faced with this new type of question we need to do something 
different. What we’ll do still uses a computer, but now we’ll simulate the physical 
process of drawing a circle C, using points chosen randomly from the interior of a 
given circle, C,. That is, our computer will ‘draw’ many such random C, circles and 
literally count the fraction of them that are totally inside C;. The computer code that 
accomplishes this will be developed by an analysis that is distinct, separate, and 
independent of the mathematical arguments used to arrive at the integral in our 
theoretical result. So, here’s how to create what physicists call a Monte Carlo 
simulation of the problem, a technique that in the pre-computer days of the 1920s 
Edwards could only have imagined in a science fiction fantasy. 

Given three points that are not collinear, p;,p2,and p3, where p; =(X1,y}), 
P2 = (X2, Y2), and p3 = (x3, y3), we form two chords: chord a as p,p2 and chord b 
as pops, with centers as (“4% ,¥5%) and (“2% 2793), respectively. The equations 
of these two chords are 


Ya =Ma(x— x1) +1 


and 
Yp = Mp(K — X2) + Yo 


where m, and m, are the slopes of chord a and chord b, respectively. In fact, 


fie Y2—¥1 
X2 — X] 
and 
fi, = Y3 Yo 
X3 — XQ 


The center of C, is the intersection point of the perpendicular bisectors of the 
two chords (dashed lines in Fig. 1.8.1). The slope of a line perpendicular to a line 
with slope m is the negative reciprocal of m, and so the equations of the perpen- 
dicular bisectors are 


1 
(x ate) nS Y2 


Ma 2 2 
and 
1 X2+X3\ | Yo + 3 
YB np (x 2 ) . oe 
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The intersection point of the bisectors (the center of C2) is such that y, = yg and 
so, solving for the x-ordinate of the center, we have 


- mamp(y, — y3) + Mp(X1 + X2) — ma(X2 + x3) 


a 2(mp — ma) 


The value of y,, the y-ordinate of the center, is found by substituting x, into 
either of the ya, yg equations. Finally, the distance of the center of C, from the 
center of C, is ,/ x + yo The radius of C3 is the distance between the center of C, 
and any one of the three points pj, po, p3. As long as the sum of these two distances 
is no more than 1, C> is inside C;. Otherwise, C2 penetrates C). 

The MATLAB code circles.m performs all of this grubby number-crunching, 
over and over, a total of one million times, keeping track of how many of those 
times C, is inside C,. Running circles.m numerous times produced estimates’! for 
the probability C, is inside C, ranging over the interval 0.39992 to 0.400972. 
Comparing this interval with the theoretical result we computed earlier, 
0.418879, leaves one (me, anyway) with a feeling of concern. A million samples 
is a lot of samples, and yet we have a disagreement between theory and “‘experi- 
ment’ of about 5 %. That’s not an insignificant difference. In addition, you’ lI notice 
that the code’s interval of estimates does not include the theoretical result while, in 
general, multiple Monte Carlo computer simulations will nearly always bound a 
theoretical result, sometimes overestimating and other times underestimating the 
theoretical value. It is difficult to look at the simulation results and not to come 
away with the feeling that the actual probability C, is inside C, is exactly 0.4. That 
is, 2 = a3 rather than a = Tae But that’s simply speculation on my part. 

Why the lack of better agreement between theory and experiment? I don’t know. 
Perhaps there is a subtle error in the theoretical analysis. Or perhaps I made an error 
in the code. But it doesn’t matter, for this book. My only point with this example is 
to show you how a theoretical analysis (involving an integral) and a computer can 
work together. Something is not quite right here, but I’m going to leave it to some 
enterprising reader to dig it out. If that reader is you, send your work to me and I'll 
feature it in the second edition of this book! 


'! This interval of estimates is a result of the code’s use of a random number generator (with the 
rand command)—every time we run the code we get a new estimate that is (slightly) different from 
the estimates produced by previous runs. 
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circles.m 


1 Introduction 


% Created by P.J.Nahin (9/12/2012) for Inside Interesting Integrals. 
% This code performs simulations of the 'circle in a circle’ problem 
% one million times. 

inside=0; 


for loop1=1: 1000000 


for loop2=1:3 
done=0; 
while done== 
x=-1+2*rand;y=-1+2*rand; 
ifx/2+y*2<=1; 
px(loop2)=x; py(loop2)=y;done=1; 
end 
end 
end 
ma=(py(2)-py(D)/(px(2)-px(1)); 
mb=(py(3)-py(2))/(px(3)-px(2)); 
xe=ma*mb*(py(1)-py(3)) + mb *(px(1) + px(2))-ma*(px(2) + px(3)); 
xc=xc/(2*(mb-ma)); 
ye=(-I/ma) *(xe-((px(1)+px(2))/2)); 
ye=yer (py(1)+ py(2))/2; 
center=sqrt(xc/\2+yc"2); 
radius=sqrt((xc-px(1))*2+ (yc-py(1))2); 
if centert+radius<=1 
inside=inside+ 1; 
end 
end 


inside/loop1 


For a second example of where integrals come from, let’s go back to June 
1827, when the Scottish botanist Robert Brown (1773-1858) observed (through a 
one-lens microscope, that is, a magnifying glass, with a magnification in excess of 
300) the chaotic motion of tiny grains of plant pollen suspended in water drops. 
This motion had earlier been noticed in passing by others, but Brown took the 
time to publish what he saw in a September 1828 paper in the Philosophical 
Magazine, and thereby initiated a search for what was going on. The German-born 
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Fig. 1.8.2 Typical paths of two-dimensional Brownian motion (each 1,000 steps) 


physicist Albert Einstein (1879-1955), in a series of papers published between 
1905 and 1908, applied statistical mechanics to show that what is now called 
Brownian motion is the result of the random bombardment of the particles by the 
molecules of the suspension medium. Indeed, Brownian motion is viewed as 
strong macroscopic experimental evidence for the reality of molecules (and so 
of atoms, too). 

Figure 1.8.2 shows four typical paths of particles executing Brownian motion in 
two dimensions,'? and they are pretty erratic. In fact, in the early 1920s the 
American mathematician Norbert Wiener (1894-1964) made a deep analysis of 
the mathematics of Brownian motion (Einstein explained the physics), studying in 
particular what happens in the limit of a particle being continuously hit by mole- 
cules (that is, successive hits are separated by vanishingly small time intervals). 


'2 Imagine that we have defined the maximum absolute value of a step, which will be our unit 
distance. Then, in one dimension (call it x) the particle moves, after each molecular hit, a distance 
randomly selected from the interval — 1 to +1. In a second, perpendicular direction (call it y) the 
particle moves, after each molecular hit, a distance randomly selected from the interval — | to +1. 
Figure 1.8.2 shows the combined result of these two independent motions for four particles, each 
for 1,000 hits (the four curves are MATLAB simulations). 
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In that limit, Brownian motion becomes what mathematicians somewhat forbid- 
dingly call a Wiener stochastic random process. Each realization of such a process 
is called a “Wiener random walk,’ and they are continuous curves that are so kinky 
they fail, at almost every point, to have a derivative (that is, to have a direction)! 
Now, suppose at time t=0 we put a particle at the origin of a plane and then 
watch it execute a one-dimensional Wiener walk on the x-axis. Where will it be at 
some later time t > 0? Certainly it will always be on the x-axis, but where? Since the 
walk is random, the best we can do is give the probability the particle will be 
somewhere, and this was one of the first things Einstein calculated in 1905. To be 
specific, let’s write W(x, t) as the probability the particle will be somewhere in the 
interval (x, x+Ax) at time t. (The W is, of course, in honor of Wiener.) Let’s 
assume this probability is, for very short intervals, /inear in Ax (i.e., double the 
length the of the interval and so double the probability the particle is there), and so 


W(x, t) = f(x, t)Ax 


where f(x, t) is called the probability density function of the Wiener walk (a density 
because we multiply it by the interval length Ax to get the probability). 

Einstein showed, through ingenious physical arguments (which we can ignore 
here), that f(x, t) is the solution to the second-order partial differential equation 


Of O7f 
a ae 


where D is a constant. (D is determined by a number of physical constants, like the 
mass of the particle and the temperature, and Einstein derived a formula for D, but 
for us it is sufficient to just write D.) This differential equation is, in fact, a famous 
one in mathematical physics, called the heat or diffusion equation, and so D is 
called the diffusion constant. In the usual appearance of this equation, the function 
being solved for is the temperature in a solid as a function of location and time, but 
Einstein showed that the probability density function for the Wiener walk satisfies 
the very same equation. Amazing! 
The solution for f(x, t) is 


which is easily verified by direct substitution, although it can be formally derived 
using nothing but simple combinatorial (that is, purely mathematical) arguments."* 
Since the particle has to be somewhere (I do hope that is obvious!) it must be true 


'STf you are curious about the details of such a derivation, you can find them in my book Mrs. 
Perkins’s Electric Quilt, Princeton University Press 2009, pp. 263-267. 
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that if we integrate the probability density over the entire x-axis we have to get a 
probability of 1. That is, 


for all t> 0.!4 
From elementary probability theory we know the average value of x, at any time t, is 


<x >= | x f(x, t)dx = 0. 


—oo 


This is mathematically so because f(x, t) is even and so the integrand is an odd 
function of x, and it is physically so because a one-dimensional Wiener walk is 
equally likely to move in either direction at every instant in time. And yet, as 
Fig. 1.8.2 clearly illustrates, a two-dimensional Wiener walk does tend to slowly 
migrate away in absolute distance from the origin at t increases. A measure of this 
drift is the average squared value of x (because then the individual horizontal (and 
vertical) movements of the particle that have opposite signs don’t tend to cancel 
each other). So, like Einstein, let’s calculate 


CO 1 CO 
ee | riijtis= | x? eo /4Didx 


= 2V/nDt 


or, since the integrand is an even function of x, 


—oo 


<x >= 


1 id 2 ,—x?/4Dt 
x“e * dx. 
ak 


} 


Making the obvious change of variable u = 75, we have 
du 2x x 
dx 4Dt 2Dt 
and so 
2Dt 
dx = — du 
x 


Or, since x = 2\/Dt,/u, we have 


'* For a proof of this, see Mrs. Perkins’s, pp. 282-283. 
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2Dt du du 
dx = —)=vDt —. 
2V/Dt (=) 


Thus, 


<x >= 


1 [° > du 4 | = 
—— | 4Dtue "VD =Dt—| Vue “du. 
vVxDt Jo ' Va ‘Va 


At this point we actually have Einstein’s basic result that < x’ > varies linearly 
with t because, whatever the value of the integral, we know it is simply a number. 
For us in this book, however, the calculation of the integral (which has appeared in a 
natural way in a physical problem) is the challenge. In Chap. 4 we’ll do this 
calculation—see (4.2.8)—and find that the integral’s value is 5 VT. So (and just 
as Einstein wrote), <x* > =2Dt. 

For my third example of where integrals come from, this time from pure 
mathematics, just imagine someone has just dropped this on your desk: show that 


f {x} - (2 ax = —1 + 1n( VIR) = 0.08106... 


where {x} denotes the fractional part of x (for example, {5.619} = 0.619 and {7} =0). 
Holy cow!, Ican just hear most readers exclaim, how do you prove something like that? 
The authors of Irresistible Integrals outline a derivation (see their pp. 92-93) but skip 
over a very big step, with just a tiny hint at how to proceed. At /east as interesting as the 
derivation, itself, is that the integral was not simply “made-up out of the blue,’ but is 
actually the result of a preliminary analysis. 

Before getting into the derivation details, it is useful to get a ‘physical feel’ for 
the integral. In Fig. 1.8.3 the integrand is plotted over the interval | <x < 20. You 
can see from that plot that the integrand starts off with a negative area over the 
interval 1<x<1.5, which is then partially cancelled with positive area from 
1.5<x<2, followed by a negative area from 2 <x <2.5, which is then almost 
cancelled by positive area from 2.5<x<3, and so on. These alternating area 
cancellations are never quite total, but as x — oo the area cancellations do become 
ever closer to total, which physically explains why the integral exists (doesn’t blow- 
up). Since the negative areas are always slightly bigger in magnitude than the 
positive ones, the final slightly negative value for the integral does make sense. 

We can numerically check these observations with quad, over the integration 
interval in Fig. 1.8.3. Thus, guad(@(x)(x-floor(x)-0.5)./x,1,20) = —0.0769..., 
where floor(x) computes the largest integer less than x. That is, floor(x) rounds x 
down and so x —floor(x) = {x}. This is in pretty good agreement with the Irresistible 
Integrals theoretical result. 
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Fig. 1.8.3 The Irresistible Integrals integrand 


We start with a famous result in mathematics, Stirling’s asymptotic formula for n!: 
nl ~ J2nn™ eo, 


named after the Scottish mathematician James Stirling (1692—1770)—although it is 
known that the French mathematician Abraham de Moivre (1667-1754) knew an 
equivalent form at the same time (or even earlier)—who published it in 1730. 
Factorials get very large, very fast (my hand calculator first fails at 70!), and 
Stirling’s formula is quite useful in computing n! for large n. It is called asymptotic 
because, while the absolute error in the right-hand side in evaluating the left-hand 
side blows-up as n— oo the relative error goes to zero as n— oo (that’s why ~ is 
used instead of =). That is, 


; n! 
ite ny 


JV2n n®tsen 


or, alternatively, 


! 
fii co3¢ 2 


n™3 eon 


Tuck this away in your memory because we’l] use it at the end of our derivation 
of the above integral. So, here we go. 
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We start by writing 


In{n!} =In{n(n — 1)(n— 2)... (3)(2)(1)} = In(n) + In(n — 1) +... 


or, since In(1)=0, 


In{n!} = $>_, In(k) 


Next, first notice that since 


[ %= antl = 


k 
n dx 
noth = Sead 


then 


and then further notice that 


Thus, 


In{n!} = So apae of +}. 
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_+1n(2) + In(1) 


So far, so good. It is at this point, however, that the authors of /rresistible 
Integrals write that the next thing to do is “exchange the order of the two sums,” 


and then they immediately write 


In{n!} = [: naa 


where the notation |x| means the integer part of x (for example, |5.619| =5). 


Clearly, 


x = [|x| + {x}. 


This ‘exchange’ step may look mysterious to you (it did to me, at first!), but 
here’s how to see it. Write down the terms of the inner sum for each value of k as 


that index goes from 2 to n (the outer sum): 
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As written, the double summation adds all these integrals horizontally, across 
row by row. Exchanging the order of the sums simply means to add all the integrals 
vertically, down column by column. You get the same answer, either way! Thus, 


infot} =(0-[ S+o-af B+ o-af Se-4f" S 


1X 2% 3 x n-1 X 
2 _ 3 2 4 at n 
= [ OPaxt [| Oa e |S act +| ie 
1 XxX 2 Xx 3 X n-1 X 


The general form of the terms in the last summation is, with 1 <j<n-—1, 


Xx Xx 


ix (ae ie = ie: Bas 


Jj J 


because, for the integration interval j <x <j+1, we have by definition that |x| =j. 
Thus, 


In{n!} = [ naa 


as claimed in /rresistible Integrals. 
Now, since 


Ix] =x- {x} 


then 


n— [|x| =n-— [x — {x}]} =n—x+ {x}. 


So, 


1 
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ny _ n n n 
in{nt} = | : ES -| ax | dx 4 | see 
1 x 1% 1 1% 
n 
1 
=nIn(n) — (n— 1) 4 | VO ie tn) n+1+-=In(n 
1 X 
n{x} 5 
= {n+ — ]In(n) n+1+| 2 
1 x 
1 
{x} - 2 
1 n 
=In es :) +In(e™) + 1+ i - dx 
1 n {x}—-} 
=1n(0*? 0) vier x *) 
n {x}-3 
=In n+ 5 | dx 
ete 
So, 
Pee 
I+ 2 dx 
n! = n"tz ee | & 
or, 
nn Seg 
| 2 dx n! 
e Jl x = : 
n3 eon 


Thus, 


1+ [- OS 2a, a In(v2n) 


1 


and so, just as Irresistible Integrals claimed, 
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1 
(Pre +In(v2r) . 


(1.8.1) 


1 x 


To really be sure you’ve understood the derivation of (1.8.1), try your hand at the 
second challenge problem of Chap. 5 (when you get there). 


1.9 Last Words 


In a rightfully famous (and very funny) collection of autobiographical essays, 
physicist Richard Feynman writes’? 


I had learned to do integrals by various methods shown in a book that my high school 
teacher Mr. Bader had given me. ... it was for a junior or senior course in college. It had 
Fourier series, Bessel functions, determinants, elliptic functions—all kinds of wonderful 
stuff that I didn’t know anything about. That book also showed how to differentiate 
parameters under the integral sign—it’s a certain operation. It turns out that’s not taught 
very much in the universities; they don’t emphasize it. But I caught on how to use that 
method, and I used that one damn tool again and again. So, because I was self-taught using 
that book, I had peculiar methods of doing integrals. The result was, when guys at MIT or 
Princeton had trouble doing a certain integral, it was because they couldn’t do it with the 
standard methods they had learned in school. If it was contour integration, they would have 
found it; if it was a simple series expansion, they would have found it. Then I come along 
and try differentiating under the integral sign, and often it worked. So I got a great 
reputation for doing integrals, only because my box of tools was different from everybody 
else’s, and they had tried all their tools on it before giving the problem to me. 


Feynman was writing of his experiences in the late 1930s, long before Wol- 
fram’s on-line symbolic integrator was even just a science fiction fantasy, much less 
actually available. And so while he was clearly having fun doing integrals, there 
was also areal pay-off to his knowing a ‘trick’ that others didn’t know. Later in the 
same book he writes'® of an encounter he had with another analyst who was 
stumped by an integral that had appeared in his work during the atom bomb project 
in the Second World War: 


When one of the guys was explaining [his] problem, I said, “Why don’t you do it by 
differentiating under the integral sign?’ In half an hour he had it solved, and they’d been 
working on it for three weeks. So, I did something, using my ‘different box of tools.’ 


Later in this book Ill show you numerous examples of Feynman’s favorite trick 
of ‘differentiating under the integral sign’ (which can be traced all the way back to 


'STn the essay titled “A Different Box of Tools,” in Surely You’re Joking, Mr. Feynman}, 
W. W. Norton 1985, pp. 84-87. 


'6Tn the essay “Los Alamos from Below” in Surely You’re Joking, Mr. Feynman}, pp. 107-136. 
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Leibniz in the late seventeenth century), although it seems the final form of it that 
we use today is really a post-Leibniz development. We’ll also use other tricks 
involving the more familiar operations of change of variable (as we did in the 
‘circle in a circle’ integral in the previous section), power series, and integration- 
by-parts. And, as I promised in the Preface, we’ll explore contour integration, too. 
In fact, why wait? Let’s get started right now. 


1.10 Challenge Problems 


Before moving on to the next chapter, however, here are four challenge problems 
for your amusement. 


(C1.1): Use the “sneaking up on a singularity’ trick to evaluate 
| 8 dx 
(ae 2 


This is an improper integral because of the singularity in the integration interval 
at x = 2, but it does have a value. Repeat for the integral 


i dx 
oa" 


and show that, despite the singularity at x = 1, this integral also has a value. Notice 
that unlike in the first integral, the integrand is always positive (there is no 
cancellation between negative and positive areas). Nevertheless, the integral still 
has a value. 


(C1.2): Show that 


| oo dx 

i vxe-1 

exists because there is a finite upper-bound on its value. In particular, show that the 
integral'’ is less than 4. 


'7 For a discussion of how this integral appears in a physics problem, see my book Mrs. Perkins’s 
Electric Quilt, Princeton 2009, pp. 2—3 (and also p. 4, for how to attack the challenge question— 
but try on your own before looking there or at the solutions). 
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(C1.3): What is the answer to the Feynman integral puzzle in (1.6.1)? Start by 
deriving (1.6.1) and think about just how arbitrary the constants a and b really are. 


(C1.4): For c any positive constant, start by confirming that the integral 


is transformed by the change of variable y = cx into the integral 
© e-y 
| — dy. 
o Yy 


Now if this is so then with a and b any two positive constants it would seem we 
could argue that 


CO g—aX _ g—bx OO ,—ax oo ,—bx 00 4-y oo 4-y 
1=| a ax = | <x | = x= | —ay— | © ay 
0 x y y 


= 0. 


But, as we’ll see in Chapter 3, in (3.3.3), 
oo ,—-ax _ ,—bx 
1=| ee ax =in(2) 
0 x a 


which is zero only for the special case of a=b. So, there’s the puzzle—what’s 
wrong with the first argument that claims I is zero for any positive a and b? 


(C1.5): Here’s one more example of an integral that appears in a real-world 
situation, and of how MATLAB makes short work of it. Mercator’s integral, 
named after the inventor—Gerardus Mercator (1512-1594), born in what is today 
Belgium—of the famous Mercator map that renders the spherical surface of the 


05 
‘ 0 . . ; 
Earth on a planar map, is | wos(ey It appears as a ‘distortion’ or ‘warping’ factor 
0 OSs 


in the construction of a “flat map’ (8, and 0, are the latitude extremes of the map). 
Mercator (who was a cartographer and not a mathematician) encountered this 
distortion in 1569, long before analytical integration techniques were developed, 
and he was forced to deal with it by other means (wouldn’t he have loved 
MATLAB!). Today, of course, he would just use a table of integrals. What is the 
value of Mercator’s integral if 0, =O and @2 = 3 (60 )? MATLAB computes quad 
(@(x)1./cos(x),0,pi/3) = 1.3169579. . .. (If you have a table of integrals handy, then 
you should find that the theoretical answer is In(2 + V3) = 1.31695789....) 


Chapter 2 
‘Easy’ Integrals 


2.1 Six ‘Easy’ Warm-Ups 


You should always be alert, when confronted by a definite integral, for the happy 
possibility that although the integral might look ‘interesting’ (that is, hard!) just 
maybe it will still yield to a direct, frontal attack. The first six integrals in this 
chapter are in that category. If a and b are positive constants, calculate: 


= 1 
(2.1.a) | ————_—_——. dx 
1 (x+a)Vvx-1 
and 
ioe) az 
2.1.b Infl+—)d 
( ) i o( % 2) ij 
and 
°° In(x) 
2.1.¢c ———, dx 
( ) i) x2 +b? 
and 
ca | 
(2.1.d) | =e 
0 1+ e% 
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Finally, calculate 


= 1 
2.1.e —{ dx 
( ) . x+xv2 
and 
ee dx 
(2.1-f) [. cosh(x)’ 


For (2.1.2) make the change of variable x—1 = t” and so 


dx _ 


— = 2t 
dt 


or 


dx = 2t dt = 2vVx — 1 dt. 


Since 
x=14+0 
then we have 
[ «= |" 2Vx—Tdt -.[° dt 
1 (x+a)Vx—1 o (1+@+aye—-1 Jo @tD+2 


We immediately recognize this last integral as being of the form 


dt 1 ea (‘) 
= — tan 
e+t Cc c 


and so 
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which gives us 


00 1 ot 
(2.1.1) | ae 


As a check, for a = 99 we have the value of the integral equal to7, = 0.31415..., 
while quad says quad(@(x)1./((x+99).*sqrt(x-1)),1,le5) = 0.30784. ... Notice that 
the upper limit of infinity has been replaced with the finite (but ‘large’) number 10°. 

For (2.1.b) integration-by-parts will do the job. That is, we’ll use 


| udv = (wl - | v du, 
0 0 


where 


So, 
OO 2 2 love) 2 2 1 
| In ens dx = ¢< xIn{ 1-4 5 | x . 5 5 dx 
0 x 0 x xe +a 
0 
~ 1 . 
= 20 5 = 5 = 2a?¢ — tan! - = 24 tan *(oo) 
o Xt +a a a ; 
and thus! 


‘Tn this derivation we’ve assumed lims_.oxIn(1 +#) = limy_.50x1In(1 +%) =0. To see 


that these two assumptions are correct, recall the power series expansion for the log function 


when p © 0: In(1 + p)=p-— 5p +ip' —--+. So, with p cs (which — 0 as x 00), we have 
: ; 2 3 , 
xIn(1 + =) aE $(2) +(8) | = ta +--+ which —0 as x— oo. On the 


other hand, as x0 we have xIn(1 =) & xIn(®) x In(a?) — x In(x”) = x In(a?) — 2x In 
(x) and both of these terms go to zero as x goes to zero (the first term is obvious, and in the second 
term x vanishes faster than In(x) blows-up). 
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oe 2 
(2.1.2) f.’n(1 +5) dx =a. 


As a check, for a= 10 we have the value of the integral equal to 31.415926. .., 
while quad says quad(@(x)log(1+(100./x.42)),0,1000) = 31.31593.... 


For (2.1.c) let x = } and so dx = —4 dt. Our integral then becomes 
ae 1 0 In t 1 0 In 1 
= | ah dx — | (t) 5 5 dt = | @) dt 
0 x2 +b ag +b \ t oo 1+ b*t? 
_ [° In(t) 
Jo 1402 


Let s= bt (and so dt = j ds). Then, 
%°  ‘In(t °° In(s 1 
= | a dt = | n(j) (5) « 
9 bt+1 9 st t+1\b 
1 °° In(s) °° In(b) 
:| | s*+1 +f a Tad 


or, as the first integral in the brackets is zero—we showed this in (1.5.1)—then we 
have 


In(b) (° 1 In(b) “4 oo 
I= b D 241 B= b { tan (s) }|o 
and thus 
co In(x) _ 
(2.1.3) | if, Se Or pln) 


Notice that this reduces to zero (as it should) when b= 1. For b= 2 our formula 
says the integral is equal to $1n(2) = 0.544396... and MATLAB agrees: quad(@ 
(x)log(x)./(44+x.42),0,10000) = 0.543365. ... 

For (2.1.d) a simple substitution is all we need. Letting u=e** (and so du = ae™ 


and thus dx = #4 = a) we have 


ae* 
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a ( od du 1(° = du 1(° f1 1 
—— dx= = = du 
9 1+e%* , I+u \au aj, ul+u) aj, lu I+u 


= ~{in(u) —In(1 +u)}|" = zin(; ; ) j 


+u 
or, 
SP oil In(2) 
2.1.4 = 
( ) I il ap Gee 2 a 
For a= 1, for example, the integral’s value is 0.220635 ..., and in agreement we 


have quad(@(x)1./U+exp(pi*x)),0,1000) = 0.220635 .... 
For (2.1.e), consider the indefinite integral 


| dx | x 
— dx. 
x +xm xl-m 4] 


Notice that 


1—m)xi™! (1—m)x™ 
— I 1—m 1) = ( = 
n(x + ) xi-m +4 1 xi-m + 1 


and so 


where C is an arbitrary constant of integration. Thus, with m = V2, we have 


ae {in +1)} 


or, because | — J/2 <0 and so lim, soox!-¥? = 0, a bit of elementary complex 
number arithmetic gives us our answer: 


Co 


v2 


(2.1.5) fe“ = (1+ -v2)in{1 + 22(1 got 


The expression on the right is 1.5063322..., while quad says the value of the 
integral is quad(@(x)1./(x+x.Asqrt(2)),sqrt(2),le5) = 1.48592. ... 
For (2.1.f) let t=e* and so a =Cord=#= 


e t 
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Then, 
[- dx a dx [ dx fe 1 dt 
Lge cosh(x) J_,,e +e" oo * +e™* Of 4 It 
2 t 
ie = 1/4] _ 9 f% 
| wy tt = 2tan (Ole 2(5) 
and so 
co dx _ 
(2.1.6) | ores =i 


MATLAB agrees, as guad(@(x)1./cosh(x),-20,20) = 3.1415929. .... 


2.2 A New Trick 


The next four examples illustrate an often powerful trick for calculating definite 
integrals, that of ‘flipping’ the integration variable’s ‘direction.’ That is, if x goes 
from 0 to x, try changing to y=a—x. This may seem almost trivial, but it often 
works! With this idea in mind, let’s calculate 


1/2 sin (x) 
(2.2.a) | yxy jews 


and 
*  xsin (x) 
2.2.b ——,—. d 
( ) | 1+ cos?(x) 7 
and 
m/2 sD 
(2.2.c) | a ED ae 
9 sin(x) + cos (x) 
and 
1 
(2.2.4) | we 
o xX +1 
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For (2.2.a), make the substitution x = 5 — y. Then, dx = — dy and 


0 sin (5 _ y) n/2 cos (y) 
dy) = d 
iF sin (§-y) + cos (§—y) = I cos (y) + /sin(y) 


Adding this expression to the original I (and changing the dummy variable of 
integration variable y back to x) gives 


a=." ‘/ sin (x) 7T v/ cos (x) ax=[or=%, 
0 Ysin@x) + Veos(x) Jo 2 
and so 

t/2 vsin(x) i 
(2.2.1) Hf Jsin(x) + /cos(x) Para 


This says the integral is equal to 0.785398. .., and quad agrees: quad(@(x)sqrt 
(sin(x))./(sqrt(sin(x))+sqrt(cos(x))),0,pi/2 )= 0.785398 .... 
In (2.2.b) make the substitution y = a—x (and so dx = — dy). Then, 


1-|' (n-y)sin(e-¥) gy) 


x 1+ cos?(x—y) 


_ [. (x — y){ sin (x) cos (y) — cos (x) sin (y) } iy 
0 1+ {cos (x) cos (y) + sin (z) sin (y)}* 
_ {* @=y)sin(y) 4 f* sin) * _ysin (y) 
am i 1+ cos2(y) a= a 1+ Roo \ 1+ cos2(y) 
That is, 
wil sin (x) 
a | 1+ cos?(x) , 
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Now, let u = cos(x) and so $¢ = — sin (x) (that is, dx = — du/sin(x)). Thus, 
xf! sin (x) du af du at de ie 
I = = — = t -1 
5], 1+ ( aw) Al 14+ al ie il an (u)}|_, 


| a ain al © 
=5 [tan (1) — tan co)§| | | 


4.4 4 
So, 
™ xsin(x) _& 
(2.9.9) ae ee tc 


This is equal to 2.4674 ..., and quad agrees as quad(@(x)(x.*sin(x))./U +(cos(x). 
A2)),0,pi) = 2.4674 .... 


For (2.2.c), make the substitution x = 5 — y. Then, dx = — dy and 


a ee 


x/2 sin (5 _ y) + cos ( —y 


dy). 
y ay) 


Since 
sin e y) = sin () cos (y) — cos (6) sin (y) = cos (y) 
and 
cos G - y) = Cos (5) cos (y) + sin () sin (y) = sin (y), 
we have 


= m/2 cos *(y) 
=|. SG ae 


and so, changing the dummy variable of integration back to x, 


n/2 2.9 5 n/2 
= | sin be) 0s (x) i | 1 ds 
cos (x) + sin (x) cos (x) + sin (x) 
0 


2.2 A New Trick 


Now, change variable to 


Then we have 


dz _zcos*(5)+58in*(5) og 2(X 
dx cos * (3) — cos (3) ees a [1 cas 6) 


or, 
dz 1+2° 
dx 2 
and so 
2, 
dx = ——~ dz. 
x tae Z 


From the double-angle formulas from trigonometry we can write 


sin (x) = 2sin 6) cos 6) =2 = < cos*(>) 


and so 


1 2 
sin (x) = 2 tan () z 


271+ tan (5) Segoe 


as well as 


51 
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Next, writing the integrand as a partial fraction expansion we have 


oma iy 1 1 2 fi 1 1 
cera ererceeraerer cea came Rte re a} 


_ 2 | : dz | : dz 
272 |Joz+tV2—-1 oz—1— V2]. 
Letting u = z+ V2 — 1 in the first integral in the brackets gives us 


i — -[" © = in(uy|%2 =1n( v2 ) 
oo a Vir U veo V2-1/) 


Letting u = z — 1 — V2 in the second integral in the brackets gives us 


j dz [ du fata) ibe \ ( V2 ) 
a — =In . 
9z—1=—vV2 -1-/2 u a f+ /2, 


Thus, 


= z In v2 In v2 = 2 In v2 wit v2 
—2v2| \v2-1 Lev2}| Be \v2-1 42 


_ 1) fitv2\_ 1) [itv2 v2+1 


Go. \fnmt) fi Vata 221 


2I 


1 2+1+2 2 1 
oe jg | ee In(3 + 2v2) 
V2 2=1 V2 
or, 
1/2 sin? (x) a ihe 
(2.2.3) 1h SaicosGn) dx = ins qe 2v2) ‘ 
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The value of the integral is 0.623225. .., and MATLAB agrees as quad(@(x) sin 
(x).42./(sin(x)+cos(x)),0,pi/2) = 0.623225 .... 
In (2.2.d) let 


sin (0) 
cos (8) 


x = tan(@) = 


and so 


dx cos?(@) + sin*(0) 5 
do cos 2(6) ey) 


and thus we have dx = {1+ tan*(0)} d6 and so our integral is 


— fiinx+1) 4 Inf{tan (8) +1}, 
=| Sat x= | Ty tan (6) {1+ tan?(0)} do 


1/4 
= | In{ tan (8) + 1}d0. 
0 


Now, make the change of variable that ‘flips’ the direction of integration, that is, 
u = 7 — 9 (and so du= — d@). Then, 
0 T /4 14 
1=| in{ tan (Fu) +1}(—du) = | In{ tan (7 —u) +1} du 
/4 4 0 4 


TT 


or, changing back to 0 as the dummy variable of integration, 


/4 1X 
1=| In{ tan (= —@) +1} a0. 
i 4 


Next, recall the identity 


___ tan (or) — tan (B) 
tan (a — B) = 1+ tan (x) tan (B) ” 


With « = | and B=90 we have 


1 _ tan (#) — tan (0) _ 1— tan (0) 
oe c 8) mare ()tan(0) 1+ tan(0) 
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m/4 l—t 0 a /4 2 

1=| fe ao = | ind ~~ 4 ag 
0 1 + tan (6) 0 1 + tan (6) 
/ 1/ 


m/4 4 
| In{2}d0 — | In{1 + tan (0)}d0. 
0 0 


But the last integral is I, and so 
T 
I =—-In(2) -I 
*in(2) 


or, at last (and using x as the dummy variable of integration), 


1 In(x + 1) _ p/4 _t 
(2.2.4) i za OX= Sy Inf + tan(x)}dx=FIn(@2). 


This integral is often called Serret’s integral, after the French mathematician 
Joseph Serret (1819-1885) who did it in 1844. Our result says the two above 
integrals are both equal to 0.27219826 ... and quad agrees, as quad(@(x)log(tan 
(x)+1),0,pi/4) = 0.27219826 ... and quad(@(x)log(xt1)./(x.42+1),0,J) = 
0. 27219823. ... 

If we make the change of variable x = we can generalize this result as follows. 


Since dx = dt, then 


5 in(2) = j meen dx = cee (ja) = af a 


qari 0 eta? 


“In(t 1 t 
| mt 2a) dt — In(a) tan ( | 
go t+a a a 4 


[ao a dt ata) [tan ~'(1)] 


9 t+a2 a 

“In(t + a) 1 *“In(t + a) 1 

dt 1 = ——— dt — -] 
| ?+a2 4a ate) af 2 + a2 4 a2) 

Thus, 
* In(t + a) 1 A T 2n 

=F iO) ey i) 1 

| 2+ a2 q, Ne) ge = ge) +g 
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or, finally, changing the dummy variable of integration back to x, 


(95) fo BSP S dx = Ein(2a’). 


OR ae 


2.3. Two Old Tricks, Plus a New One 


The following integral, with arbitrarily many and different quadratic factors in the 
denominator of the integrand, may at first glance look impossibly difficult: 


a dx . 
| (e [ 2) (2 = 23) (2 rs 2) = fe zs ay with all of the a,40 and 
different. 


Not so, as I'll now show you. Let’s start by writing the integrand in partial 
fraction form (look back at how we got (2.2.3)), as 


1 
(x? + af) (x? + a3) (x? + a3)... (x? + a2) 
er 
tat x+ap x2+ay x? + a2 


where the c’s are all constants.” Fix your attention on any one of the terms on the 
right, say the k-th one. Then, multiplying through by x + az, we have 
x? ap 
(x? + a?) (x? + a3) (x? + a2)... (x? +. a2)... (x? + a2) 
41 (ee + ay) C2 (x? + ay) 
x24 a? x? + ab 


Ch (x + ay) 
x? + a2 


ie ae © ae aa a 


Thus, cancelling the x” + a? factor in the numerator and denominator on the left 


in the above expression, and setting x to the particular value of i a, wherei = /—1, 
3 
we have” 


? Writing the partial fraction expansion this way is where the assumption that all the a; are different 
comes into play. If any of the a; appears multiple times, then the correct partial fraction expansion 
of the integrand is not as I’ve written it. 

>There are two points to be clear on at this point. First, since we are working with an identity it 
must be true for all values of x, and I’ve just picked a particularly convenient one. Second, if the 
use of an imaginary x bothers you, just remember the philosophical spirit of this book—anything 
(well, almost anything) goes, and we’ll check our result when we get to the end! 
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1 1 


(ag + af) (ag + 98) (ag + a3). (Cag aa) YT" (a? — af) 


j=l, jA¢k 


= Ck 


where only the cy, term survives on the right since all the other terms in the partial 
fraction expansion end-up with a zero in their numerator. So, our original partial 
fraction expansion is just 


=o 
(x? + a?) (x? + a3) (x? + a3) ... (x? + a2) k=l oer +a? 


and thus 


[° dx => i dx 
0 GE af) FF ad) (RE a). OF + aH) 2"), rae 


-Coveg[ee DI] -E22G 


or, at last, with all the a; 40, 


dx n Ck 
(2.3.1) (s (x2+ a2) (x2+ a3)(x?+ a3)...(x?+ a2) =( ) has a, 


ae 
10H mena? -a?) 


where c, = and a; # ajifj#i. 


For example, suppose at =, as = 4, and ay = 9. Then, a; = 1, ay = 2, and a3 =3. 
This gives the values of the c’s as 


1 = 1 a 1 1 
4=)G=1) °° GoaG=a) 16°? - . 


cj = 


Then the value of the integral is 


tJ dt tL 
(5) fi a ~ (5) E ut rH ~ (5) al ~ ie gr gel 


and quad agrees, as quad(@(x)1./((x.A2+1).*(x.42+4).*(x.424+9)),0,100) = 
0.02617989 .... 

Here’s another example of the use of a partial fraction expansion to evaluate an 
integral. Here I’ll do 


i dx 
9 X*+-+ 2x?cosh(2a) + 1 
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where « is an arbitrary constant. Writing the hyperbolic cosine in the denominator 


of the integrand out in exponential form, we have 


2a —2a 
2/e +e sofa st 4 ye ete ea 


x* + 2x*cosh(2a) + 1 = x* + 2x 
= (ie A. 7%) (x? as e724), 


So, we can write the integrand in the following partial fraction form (with A and 


B as constants): 
1 
x* + 2x?cosh(2a) + 1 


That is, 
(A + B)x? + Ae 7% + Be*® = 1 


which, since there is no x” term on the right, immediately tells us that A= —B 


Thus, 
—Be 7" + Be** = 1 


and so the constant B is given by 


Therefore, 


le dx _ [- dx [- dx 
o X4+2x’cosh(2a) +1 — eee x2 +e-2% Jy x? + e70 


5) (e : e-%) 
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or, finally, 


(233) ile a — 


x4 + 2x2 cosh(2a)+1 4 cosh(a) * 


For a= 1, for example, this integral equals 0.5089806 ... and quad agrees, as 
quad(@(x)1 ./(x.44+2*cosh(2)*x.2+1),0,1000) = 0.5089809 .... 

Back in Chap. | (Sect. 1.5) I showed you how the ‘evenness’ or ‘oddness’ of an 
integrand (if one of those two properties is present) can be of great help in 
transforming a ‘hard’ integral into an ‘easy’ one. As a more sophisticated example 
of this than was the example in Chap. 1, let’s calculate the value of 


ni dx 
9 X*+2x* cos (2a) + 1 


where, as before, « is an arbitrary constant. This may superficially look a lot like the 
integral we just finished but, as you’ll soon see, there is a really big difference in 
how we’ll do this new one. 


dy __ 2 


x 


We start by making the change of variable y = 1 (and so 
dy = =3 dy). Then, 


—J, or dx = —x 


=. dx 
Jo x4 + 2x? cos (2ct) + 1 


1 10.) 
2 [ x dy -| y? dy 
co ye t jz cos(2a)+1 Jo y*+2y* cos (2a) + 1 


If we then add our two versions of the integral (the left-most and the right-most 
integrals in the previous line, remembering that x and y are just dummy variables of 
integration) we have 


a= [" (1 + x?) dx 
9 X*+ 2x? cos (2a) + 1 


or, 


r=} f" (1 + x”) dx 


9 x4 + 2x cos (2a) + 1 


And since the integrand is even, we can write 


[= 


an (1 +x?) dx 
oo Xt + 2x? cos (2a) +1 
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Because cos(2a) = 1 — 2 sin?(a) you can show by direct multiplication that 
x’ + 2x” cos (2a) +1 = [x? — 2xsin (a) + 1] [x + 2x sin (a) + 1] 


and so 


rai [" (1+ x?) dx 


4J_., [x? — 2x sin (a) + 1][x? + 2x sin (a) + 1] 


Now, since the integrand is even, then if we include in the numerator of the 
integrand an odd function like 2x sin(a) we do not change the value of the integral, 
and so 


I=; | [x? — 2x sin (x) + 1] dx 
4J_., [x? — 2x sin (a) + 1][x? + 2x sin (a) + 1] 
or 

= a dx 

~ 4)_., x? + 2x sin (a) + 1 


Or, since sin*(«) + cos7(«) = 1 then 


i= “| dx _ an dx 
~ AJ_x. x? + 2xsin (a) + sin?(a) + cos?(a) 4 J_oo [x + sin («)]? + cos 2(a) 


Let u=x+sin(q) (and so du= dx), and then 


ne il. wy cna) 7 ; (aca) ao 


: foo} = tan! {00 
“ana {oo} —t { }] 


lo.¢) 


—0o 


and so, at last, 


x4 +2x2cos(2a)+1  4cos(a) * 


(2.3.3) | Ie S = 


Special, interesting cases occur for some obvious values of «. Specifically, for 
a = 7 we have 


O x441 40 x441 °° «4 


(2.3.4) | (ee 
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These two integrals are therefore equal to 1.11072 ... and MATLAB agrees, as 
quad(@(x)1./(x.44+1),0,1000) = 1.11072 ... and quad(@(x)(x.2)./(x.4 
+1),0,10000) = 1.11062.... For «= 30° (that is, « = %) we have 


oe) dx T 
Cae) Remar mara 


This is equal to 0.906899 ..., and again MATLAB agrees as quad(@(x)1./(x.4 
+x.42+1),0,1000) = 0.9068993 .... For «= 60° (that is, « = 3) we have 


(2.3.6) CP =!. 


xt-x241 2 


This is equal to 1.570796 ..., and indeed guad(@(x)1./(x..4-x.424+1),0,1000) = 
1.570796 .... And finally, for «= 0 we have 


(2.3.7) 


(os) dx _ it 
i ae 


O x44+2x24+1 


This is equal to 0.785398 ..., and quad(@(x)1./(x.4+2*x.42+1),0,1000) = 
0.785398 .... 

Here’s a new trick, one using a difference equation to evaluate a class of definite 
integrals indexed on an integer-valued variable. Specifically, 


__ [™ cos (nO) — cos (na) 
Tn(o) = | cos (8) — cos (a) ” 


where « is a constant and n is a non-negative integer (n= 0, 1, 2, 3, ...). The first 
two integrals are easy to do by inspection: Ip(a)=0 and I,\(a)=za. For n> 1, 
however, things get more difficult. What I'll do next is perfectly understandable 
as we go through the analysis step-by-step, but I have no idea what motivated the 
person who first did this. The mystery of mathematical genius! 

Tf you recall the trigonometric identity 


cos {(n + 1)8} + cos {(n — 1)0} = 2cos (8) cos (n6) 


then perhaps you'd think of taking a look at the quantity I, , ;(@) +1, _ 1(@) to see if 
it is related in some ‘nice’ way to I,(a). So, imagining that we have been so inspired, 
let’s take a look at the quantity Q= AI, + ;(a) + BI,(a) + Cl, — ;(a), where A, B, and 
C are constants, to see what we get. 
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Thus, 
" Afcos {(n + 1)0} — cos {(n + 1)a}] + B[cos (nO) — cos (na)] 
= + Ci cos {(n — 1)8} — cos {(n — 1)ax}] 
Q cos (8) — cos («) ae 
0 
Suppose we now set A= C= 1 and B= — 2 cos(a). Then, 
‘ [cos {(n + 1)0} + cos {(n — 1)0} — 2 cos (a) cos (n6)] 
Q= —[cos {(n + 1)a} + cos {(n — 1)a} — 2 cos (a) cos (nax)} dO. 


0 cos (8) — cos (a) 


From our trig identity the second term in the numerator vanishes and the first term 
reduces to 


Q= [= (8) cos (nO) — 2 cos («) cos (nO) do — (= (n8)[ cos (8) — cos («)] 40 


0 cos (8) — cos (a) 0 cos (8) — cos (a) 
= Oem = 132, 43.4 


- 2] cos (n6)d6 = 2 a 5 


0 


That is, we have the following second-order, linear difference equation: 
Tn41(@) — 2cos (a)I,(a%) + Ip_-1(a) = 0,n = 1,2,3,..., 
with the conditions Ip(a) = 0 and I,(a) =z. 


It is well-known that such a so-called recursive equation has solutions of the 
form I,, = Ce” where C and s are constants. So, 


Ce") _ 2 cos (a)Ce™ + Ce") = 0 
or, cancelling the common factor of Ce*", 
e* — 2cos(a) +e *=0 


or, 


eS — 2cos (a)e’ + 1 = 0. 


This is a quadratic in e*, and so 


, _ 2cos (a) + \/4cos?(a)-—4  2cos (a) + 2i\/1 — cos?(a) 
e-= = 
2 2 


= cos (a) tisin(a), 
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where i = ¥—1. Now, from Euler’s fabulous formula we have e* = e~ ‘® ond thus 
s=+ia. This means that the general solution for I,,(a) is 


I. (e) = Cye™ + Coe ™*. 
Since Ip(~) = 0 then C; +C.=0 or, Co =— C). Also, as I,\(a) =a we have 
Cie — Cye = 2 = Cyi2 sin (a) 


which says that 


Thus, 


~ 2sin ~ Zsin (a) i 


fee) = fs = x p 70) 


or, at last, using x as the dummy variable of integration, 


(2.3.8) (Sea SEI 


0 cos(x) — cos(a) sin(a) * 


For example, if n= 6 and « = 7 this result says our integral is equal to x = vi 
sin TI 
which is equal to 11.03747399..., and quad agrees because quad(@(x)(cos(6*x)- 
cos(6*pi/11))./(cos(x)-cos(pi/11)),0,pi) = 11.03747399. ... 
Here’s a final, quick example of recursion used to solve an entire class of 
integrals: 


—| 


L= | xe-*' dx, n = 0,1,2,3,.... 
0 


We start by observing that 


d /_m-1,-x 2n—2,,—x? 2n,—x 
= (x2@-1e?) = (2 — 1) x20 — 2x n> 1. 
ae e ) (2n — 1)x"" “e x"e * n> 


So, integrating both sides, 


lo.@) d A 10.6) 2 ‘CO 
| — pole )ax = (2n— )| x7-2e-*X dx — 2| xe dx, 
o dx 0 0 


The right-most integral is I,, and the middle integral is I, _ 1. So, 
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~ i 
| ia ee )ax Ci Tor, 
0 dx 


Now, notice that the remaining integral (on the left-hand-side) is simply the 
integral of a derivative and so is very easy to do! In fact, 


wood 2\ |00 
| ae (ele jax = Cees ) lf =0 
0 dx 


since x2"-le-* = 0 atx =O and as x > 00. So, we immediately have the recurrence 
2n—1 2n(2n — 1 
I, = Hm 14 2 NE) 
2 4n 
For the first few values n we have: 
2 


and by now you should see the pattern: 


(2n)! 
i= Ip. 
an! ° 


This is a nice result, but of course the next question is obvious: what is Ig? In fact, 


ad 2 1 
=| e “dx => Vn, 
0 2 


which we have not shown (yet). In the next chapter, as result (3.1.4), I will show you 
(using a new trick) that 


| e* 24x = V 20. 


If you make the change of variable y = x/2 (and remember that [Go 
dx =2 f° f(x)dx if f(x) is even) then the value of Ip immediately follows. Thus, 
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(23.9) f° x2%e-” dx = (2n)! (:)va . 


iz 


4™n! 


If n=5 this says the integral is equal to 26.171388..., while quad(@(x)(x.10). 
*exp(-(x.42)),0,10) = 26.1713896 .... 


2.4 Another Old Trick: Euler’s Log-Sine Integral 


In 1769 Euler computed (for a= 1) the value of (where a> 0) 
/2 
I= | In{a sin (x) }dx, 
0 
which is equal to 


/2 
| In{acos (x) }dx. 
0 


The two integrals are equal because the integrands take-on the same values over 
the integration interval (sin(x) and cos(x) are mirror-images of each other over that 
interval). For many years it was commonly claimed in textbooks that these are quite 
difficult integrals to do, best tackled with the powerful techniques of contour 
integration. As you’ll see with the following analysis, however, that is simply not 
the case. 

So, to start we notice that 


er Pome cae S ; 
1=5| [In{asin (x)} + In{acos (x)}] x=5 I, n{a sin (x) cos (x) } Xx. 


Since sin(2x) = 2sin(x)cos(x), we have sin (x) cos (x) = 5 sin (2x) and therefore 


[= if Inf asasin (2x) har = if inc) +in (5) ian (x) > 


0 0 
n/2 
1 
= 7 In(a) — * in(2) + : | In{a sin (2x) }dx 


4 
0 
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In the last integral, let t= 2x (and so dx = 5dt ). Thus, 


i Inf{a sin (2x) }dx = S| infasin (t)} at = oi 
male ol a 


where the last equality follows because (think of how sin(t) varies over the interval 
0 to mz) 


Tw 


[ In{a sin (t) }dt = 5| In{a sin (t) }dt. 
0 2 Jo 


So, 
or, 


and so, at last, for a > 0, 


a 


tt/ Tt/ 
(2.4.1) i SRG i ieee a stn 6). 


Special cases of interest are a= 1 (Euler’s integral) for which both integrals 
equal — $In(2) = —1.088793... and a=2 for which both integrals are equal to 
zero. We can check both of these cases with quad; quad(@(x)log(sin(x)),0,pi/2) = 
— 1.0888035 ... and quad(@(x)log(cos(x)),0,pi/2) = — 1.0888043 ..., while quad 
(@(x)log(2*sin(x)),0,pi/2) = — 1.0459 x 10~> and quad(@(x)log(2*cos(x)),0,pi/2) 
= — 1.1340 x 107°. We’ll see Euler’s log-sine integral again, in Chap. 7. 

With the result for a= 1, we can now calculate the interesting integral 


[nf S20 
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That’s because this integral is 


me : 2 1 x/2 
| Inf sin (x) }dx — | In{x}dx = —=In(2) — [xIn(x) — x]], 
0 
mn, (n\ 
- 5 In(2) zn (5) 5 
= + In(2) In(m) — = In(2) 
1 1 
= ——In(2) — 5 In(x) + =In(2) + 5 
= —<=In(x) + 
and so 
(2.4.2) I ae ao dx =5[1-In(w)] . 


Our result says this integral is equal to —0.22734. . . and quad agrees, as quad(@ 
(x)log(sin(x)./x),0,pi/2) = — 0.22734 .... 

With a simple change of variable in Euler’s log-sine integral we can get yet 
another pretty result. Since sin*(6) =1- cos’(0) then 


sin 7(0) 


cos ?(8) 7 tan *(8) - ‘cos 2(0) A 
and so 
tan?(0) +1 = : 
cos 7(6) 
which says 


n pes = —-in cos? = —2Z1n;4 COS =iIn an? 
inf arg p= ~In{c0s%(0)} = —2In{ cos (0)} = in tan?(0) + 1} 
That is, 


In{ cos (8)} = —5In{ tan?(8) + 1}. 
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So, in the integral 


if In{ cos (x)} dx 


0 


replace the dummy variable of integration x with 8 and write 
/2 /2 1 I 
| In{ cos (6) } dd = | [sin tan*(8) + 1}|d® = —=In(2) 
0 0 2 2 
or, 
/2 
| Inf tan?(0) + 1}d0 = aln(2). 
0 


Now, change variable to x = tan(0). Then 


dx 1 
dd cos (8) 
and thus 
dO = cos*(@)dx = : dx = : dx 
= ~ tan2(0)+ 1° x241°° 


So, since x = 0 when 8=0 and x = oo when 0 = 5 we have 


oo 2 
(2.4.3) i MS nye 


x?2+1 


That is, this integral is equal to 2.177586 ..., and quad agrees, as quad(@(x) 
log(x.42+1)./(x.24+1),0,1e6) = 2.1775581.... To end this discussion, here’s a little 
© In(x? + 1 
calculation for you to play around with: writing | ee 
0 xX 
the change of variable u = i in the last integral and show that this leads to 


dx as {j + {9°, make 


(2.4.4) 


This is equal to 1.088793..., and MATLAB agrees because quad(@(x) 
log(x+(1./x))./(x.42+1),0,1) = 1.088799. ... 
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The substitution u = tis a trick well-worth keeping in mind. Here’s another use 
of it to derive a result that almost surely would be much more difficult to get 
otherwise. Consider the integral 


[- In(x* + 1) dx 


9 X2—bx+1 


where a+ 0 and b are constants. If we let u = 1 (and so dx = —4 du), we have 


cst fe ty me) 


du 
2_ I 2 = 2 
9 X°—bx+1 ~— b+] u 9 1—bu+u 
u u 
oO | a 10.0) 
-| n(1 +u*) du | In(u) . 
9 1—bu+ wv 9 1—bu+ wv 
That is, 
 In(x* + 1 °° In(1 : S ] 
| et an | n( +x") dx | n(x) xX 
9 X*—bx+1 9 L—bx+x? 9 1—bx+x? 


and so we immediately have 


(2.4.5) (Ce i= 0: 


0 1-bx+x? 


Notice that the case of b= 0 in (2.4.5) reduces this result to (1.5.1), 


°° In(x) 
d = 
j 1 ex? =. 


what we also get when we set b = | in (2.1.3). The value of b can’t be just anything, 
however, and you’ll be asked more on this point in the challenge problem section. 

To end the chapter, let me remind you of a simple technique that you encoun- 
tered way back in high school algebra—‘completing the square.’ This is a ‘trick’ 
that is well-worth keeping in mind when faced with an integral with a quadratic 
polynomial in the denominator of the integrand (but see also Challenge Problem 
2 for its use in a cubic denominator, and look back at the final integration of Sect. 
1.6, too). As another example, let’s calculate 


1 
1— 
| 
9 1+x+x? 
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We'll start by rewriting the denominator of the integrand by completing the 
square: 


2exedaxvtxged (1a 8 ie ae 
xo +X =x°+x+- —-j=[x+- = 
4 4 2) "4 


Thus, 


1 1 1 
1- d 
en ee ee 
0 1 +x+x 0 3 1 
Now, change variable to 


ic 
u=xX a 
2 


(and so dx = du). Then, our integral becomes 


3 


2 du zu} 3 2 du 2 ou 
quae eae ame 3 du. 
2 4 2 4 z 4 z 4 


The first integral on the right is 


3 3/2 
{, du 2 : it u ) 
a= an 
Zu2 + (2) v3 v3/2 1/2 
3/2 


~Sam(3)] = 35 [0(S)-0(S) 


=F, | tan! (v3) ~ nF] = 5 *) = 5 


So, 


1 
1-x 1 2 u 
dx = du 
ae 2/3 leer 
In the integral on the right, change variable to 


3 
t=w+-. 
oer 
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Then, dt = 2u du and 


So, 
I 1-x Tt 1 
dx = In(3 
Reese 2/3 2, (3) 
or, 
Ll 
(2.4.6) I a= 


which equals 0.35759 ..., and MATLAB agrees because quad(@(x)(/-x)./U+x+x. 
A2),0,1) = 0.357593. ... 


2.5 Challenge Problems 


That was all pretty straightforward, but here are some problems that will, I think, 
give your brain a really good workout. And yet, like nearly everything else in this 
book, if you see the trick they will unfold for you like a butterfly at rest. 


(C2.1): According to Edwards’ A Treatise on the Integral Calculus (see the end of 
the Preface), the following question appeared on an 1886 exam at the University of 
Cambridge: show that 


[ OY) Gee, 


0 V4x — x? 


Edwards included no solution and, given that it took me about 5 h spread over 
3 days to do it (in my quiet office, under no pressure), my awe for the expected math 
level of some of the undergraduate students at nineteenth century Cambridge is 
unbounded. See if you can do it faster than I did (and if not, my solution is at the end 
of the book). A quick numerical check by MATLAB should convince you that the 
given answer is correct: 

quad(@(x)log(x)./sqrt(4*x-x.42),0,4) = 0.0000066. 


1 
d 
(C2.2): Calculate the value ot | r = i Hint: first confirm the validity of the partial 
0 X 
l 1 
d 1 d 

fraction expansion =, =} 4 | and so | —_— | x 

x4 3 |x4 x°—x4 9 xet1 3Jo x41 


it iy 2 
= i eo The first integral on the right will yield to an obvious change 
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of variable, and the second integral on the right will yield to another change of 
variable, one just as obvious if you first complete the square in the denominator of 
the integrand. Your theoretical answer should have the numerical value 0.8356488.. .. 


(C2.3): Here’s a pretty little recursive problem for you to work through. Suppose 
you know the value of 
| oo dx 
0 x4 + 1 


This integral is not particularly difficult to do—we did it in (2.3.4)—with a value 
of ie The point here is that with this knowledge you then also immediately know 


the values of 


f. dx 
o (x? +1)” 


for all integer m > | (and not just for m = 1). Show this is so by deriving the recursion 


[- dx | dx 
o (x41 4m Jo (x4 41)" 


For example, 


fe dx (4)(2) —1 i dx 7 i dx 


0 (xt+1)—— (4)(2) Jo (x4 41)? 8)o0 (x4 4:1)? 
and 
{ dx (41) — 1f dx —3f dx 
laa (4)(1) [ema] ea 
Thus, 


|" dx (7) (Z)[- dx = (5) mn  2in — 0.72801 
0 (x4+1)> 8) \4) Jo xt+1 (32) 2/2 64/2 ae 


MATLAB agrees, as quad(@(x)1./((x.4+1).3),0,1000) = 0.72891... 


dx 
Hint: Start with ———x and integrate by parts. 
o (x*+1) 
(C2.4): For what values of b does the integral in (2.4.5) make sense? Hint: think 
about where any singularities in the integrand are located. 


°° In(1 + x) 
(C2.5): Show that p Wa 


dx = 2a. Hint: integrate by parts. 


Chapter 3 
Feynman’s Favorite Trick 


3.1 Leibniz’s Formula 


The starting point for Feynman’s trick of ‘differentiating under the integral sign,’ 


mentioned at the end of Chap. 1, is Leibniz’s formula. If we have the integral 


where « is the so-called parameter of the integral (not the dummy variable of 
integration which is, of course, x), then we wish to calculate the derivative of I with 
respect to «. We do that in just the way you’d expect, from the very definition of the 


derivative: 


. I(a + Aa) — I(a) 
—_ = | co -—-—_..__ _.* 
ie Aa 


Now, since the integration limits depend (in general) on a, then a Aa will cause a 


Aa and a Ab and so we have to write 


b+Ab b 


I(a + Aa) — I(a) = i f(x,a+ Aa) dx — : f(x, a) dx 
= (|. +f {~ ) Als + Aa) dx — [ f(x, a) dx 
=] {f(x,a+ Aa) — f(x, a)}dx + f(x,a+ Aa) dx 

| , 


a+Aa 
-| f(x,a + Aa) dx. 


a 
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As Aa— 0 we have Aa— 0 and Ab — 0, too, and so 
limag—o{I(a + Ac) — I(a)} 


b 
= Himsa. | {f(x,a + Aa) — f(x, «)}dx + f(b, a)Ab — f(a,a)Aa 


a 


where the last two terms follow because as Aa — 0 and Ab — 0 the value of x over 
the entire integration interval remains practically unchanged at x =a or at x=b, 
respectively. Thus, 


1 b 
_ timaa-o5— | Gear Ad) haw) de 
Ot a 


; Ab Aa 
+lim ag—of(b, «) i lim jg—of (a, o) Ae 


or, taking the a inside the integral (the Riemann integral itself is defined as a limit, 
so what we are doing is reversing the order of two limiting operations, something a 
pure mathematician would want to justify but, as usual in this book, we won’t worry 
about it!), 


a Au Oe wD a 
ands, = xt (DO) GC) 


(3.1.1) a a 


This is the full-blown Leibniz formula for how to differentiate an integral, 
including the case where the integrand and the limits are functions of the parameter 
a. If the limits are not functions of the parameter (such as when the limits are 
constants) then the last two terms vanish and we simply (partially) differentiate the 
integrand under the integral sign with respect to the parameter « (not x). 

Here’s a quick example of the power of Leibniz’s formula. We’ve used, numer- 
ous times, the elementary result 


fi : dx = * tan? (*) ? == 
oX+t+a la a/ J'9 2a’ 


Treating a as a parameter, differentiation then immediately gives us the new 
result that 


or, 
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So 


(3.1.2) 


One could, of course, not stop here but continue to differentiate this new result 
again (and then again and again), each time producing a new result. For example, 
another differentiation gives 


1 31 
eee 
DO Geapaeye 16a5 


(3.1.3) 


For a=1 this is 0.58904... and quad(@(x)1./((x..2 + 1).43),0,100) = 
0.58904. ... 
A more sophisticated example of the formula’s use is the evaluation of 


CO 2 
x2 
| e 2 dx. 


—oo 


This is the famous probability integral,’ so-called because it appears in the 
theory of random quantities described by Gaussian (bell-shaped) probability den- 
sity functions (about which you need know nothing for this book). Because this 
integral has an even integrand, we can instead study 


[oe] = 
| e 2 dx 
0 


and then simply double the result. 
To introduce a parameter (t) with which we can differentiate with respect to, let’s 
define the function 


and so what we are after is 


' The probability integral is most commonly evaluated in textbooks with the trick of converting it toa 
double integral in polar coordinates (see, for example, my books An Imaginary Tale: the story of /—1. ‘ 
Princeton 2012, pp. 177-178, and Mrs. Perkins’s Electric Quilt, Princeton 2009, pp. 282-283), and 
the use of Leibniz’s formula that I’m going to show you here is uncommon. It is such an important 
integral that at the end of this chapter we will return to it with some additional analyses. 
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Note, carefully, that the parameter t and the dummy variable of integration x, are 
independent quantities. 

Differentiating g(t) using Leibniz’s formula (notice that the upper limit on the 
integral is a function of the parameter t, but the integrand and the lower limit are 
not), we get 


d t 2 f t t24x2 
ee 2| e 2 dx {est = 2| e- 2 dx. 


Next, change variable to y = * (so that as x varies from 0 to t, y will vary from 
0 to 1). That is, x = yt and so dx = t dy and we have 


d 1 (245212) 1 (14y2)2 
oe es | 2te 2 dy= | 2te 2 dy. 
dt Jo 


Now, notice that the integrand can be written as a (partial) derivative as follows: 


(14y?)? 


_ Ow)? 0 2e° 2 
~ Ot 1+y? 


That is,” 


dg [' 0 2e7- 2 d fle 2 
dt | ot y | y 


And so, integrating, 


1 (14y?)? 
e Z 


where C is the constant of integration. We can find C as follows. Let t=0. Then 


? The reason we write a partial derivative inside the integral and a total derivative outside the 
integral is that the integrand is a function of two variables (t and y) while the integral itself is a 
function only of t (we’ve ‘integrated out’ the y dependency). 
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and, as t— 0, 


(14y?)? 


1 .- 1 
e z 1 7 io 0 
d dy = tan! =-, 
|, ivy | l+y” OD|o 4 


Thus, 0 = —2() +C_ and so C = 3 and therefore 
(14y?)? 


to. 

1 e 2 
t)==-—2) ——— dy. 
g(t) =5-2| So wy 


Now, let too. The integrand clearly vanishes over the entire interval of 
integration and we have g(0o) = §. That is, 


(3.1.4) 


V2n = 2.506628 ..., and quad agrees: quad(@(x)exp(-(x.42)/2),-1000,1000) = 


2.506628 ... 
We can use differentiation under the integral sign, again, to generalize this result 
in the evaluation of 


I(t) = [° cos (tx)e“* dx. 


From our last result, we know that I(0) = «/ i Then, differentiating with respect 
to t, 


Po 2 
= | —x sin (tx)e~= dx. 
0 


We can do this integral by-parts; let u=sin(tx) and dv = —xe-> dx. Then, 


du = tcos(tx)dx and v = e-y, Thus, 
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a = { sin (wxje*} be -| 


0 


lo.<) es) 
tcos (tx)e 7 dx. 


The first term on the right vanishes at both the upper and lower limits, and so we 
have the elementary first-order differential equation 


dI(t) f rE 


i) 


a ; cos (tx)e 7 dx = —t I(t). 


Rewriting, this is 


and this is easily integrated to give 
2 
In{I(t)} = — > +C 


where, as usual, C is a constant of integration. Since I(0) = 4) we have C = In 


( #) and so 


or, at last, 


2 


a eZ t 
(3.1.5) iL, cos(tx)e 2 dx = [fer 


For t= 1, for example, our result says the integral is equal to /L= 0.760173... 
and quad(@(x)cos(x).*exp(-(x.2)/2),0,1000) = 0.760171 .... 
From this last result, if we return to the original limits of — co to co we can write 


8 T 2 2 
| e 7 cos(tx) dx =2 ae =vV2n e?. 


—oo 


Then, if we write 
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—oo —oo 


where I’ve used the trig identity for the cosine of a sum, we have 


love) love) > 


Py) 2 
e 2? cos (tx)dx — sin (| e 7 sin (tx)dx. 


—oo 


| e-* cos (s + tx) dx = cos (| 


—0o —0oo 


But since the last integral on the right is zero because its integrand is odd, we 
have 


| er cos (s + tx) dx = cos (s)| e? cos (tx)dx 


and so, finally (using our result (3.1.5)) 


00 x2 t2 
J.@ 2 cos(s + tx) dx = V2m e 2 cos(s). 


(3.1.6) 


For t=s=1 this is 0.82144... and quad(@(x)exp(-(x.12)/2).*cos(1_ + x),- 
10,10) = 0.82144... 

The trick of evaluating an integral by finding a differential equation for which 
the integral is the solution can be used to determine the value of 


where a and b are each positive (a is the parameter and b is a constant). If we 
integrate by parts, writing 


1 
u = ———_,, dv = cos (ax)dx 
x2 +b? As) 
then 
es 2 2x ee sin (ax) 
( x2 +b’) 


and so 
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2 sin (ax) o 2% xsin(ax) : 
1) = {2 Mi + | d 


x2 + b?)” ato (x2 + b?)* 


or, as the first term on the right vanishes at both the upper and the lower limit, we 
have 


_2/* xsin (ax) 2 
Ae | (x40) 


and so it perhaps looks as though we are making things worse! As you’ll soon see, 
we are not. 


From our last result we multiply through by a and arrive at 


°° x sin (ax) 
al(a) = 2] ea ey dx 


and then differentiate with respect to a to get 


dI(a) © x? cos (ax) 


aa + I(a) = [ (24Py 


The integrand can be re-written in a partial fraction expansion: 


x?cos(ax)  cos(ax) bcos (ax) 


(x24b)? +b? (x2 402)? 


Thus, 


of aco) ax=2f ee es ‘| : 
0 (x2 +b’) 0 x? +b 0 (x2 +b’) 
and, since the first integral on right is I(a), we have 


dI(a) 
da 


2 cos (ax) 


+ I(a) = 2I(a) — 20°" eae? 


or, 
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Differentiating this with respect to a, we get 


pale) oe dI(a) dI(a) = av] X sin (ax) re 
da da da 0 (x? +4 b°) 
or, 
go _ 2»? |” x sin 38 as 
da 0 (x24 b’) 


If you look back at the start of the last paragraph, you’ll see that we found the 
integral on the right to be 


0 ( x2 + b’)” 2 
and so 
d’I(a) 7a 
= 2b°~ I 
a aa? ; (a) 


or, rearranging, we have the following second-order, linear differential equation for 


(a): 


d’I(a) 


ae b? I(a) = 0. 


Such equations are well-known to have exponential solutions—I(a) =C eX, 
where C and k are constants—and substitution into the differential equation gives 


Ck7e — b?Ce™ = 0 


and so k* — b> = 0 ork = +b. Thus, the general solution to the differential equation 
is the sum of these two particular solutions: 


I(a) = Cie? + Coe. 


We need two conditions on I(a) to determine the constants C, and C2, and we can 
get them from our two different expressions for I(a): the original 


and the expression we got by integrating by parts 
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dx. 


From the first we see that 


ee 1 1 x a I 
1(0) = a= {tm} P=, 
(0) | eae Bh M/S = 


and from the second we see that lim, _, ,.I(a) = 0. 


Thus, 
(0) =—-=C, + 
2b 
and 
I(co) = 0 


which says that C; = 0. Thus, Cz = 3, and we have this beautiful result: 


fe cos(ax) ae 


(3.1.7) 0 x2+b2 


1 


discovered in 1810 by Laplace. If b = 1 anda=z then the integral is equal toFe-* = 
0.06788 ..., and quad(@(x)cos(pi*x)./(x.A2 + 1),0,le10) = 0.06529 .... Before 
moving on to new tricks, let me observe that with a simple change of variable we 
can often get some spectacular results from previously derived ones. For example, 
since (as we showed earlier in (3.1.4)) 


| ene =vV2n 


—oo 


it follows (with u = x2) that 


ey 1 
| e" du==va. 


0 2 
Then, letting t = e~*’, we have x = ,/ —In(t) (and so dx = — xo = ) and 


thus 
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love) 0 1 
2 dt 1 dt 1 
—* dx = t = = 
| ile | Ixt 5| ov" 


0 


17 


which says 


(3.1.8) 


which is 1.77245 ...., and agreeing is gquad(@(x)1./sqrt(-log(x)),0,1) = 1.77245 .... 


3.2. An Amazing Integral 


We start with the function g(y), defined as 


lo.@) 


w= [ie 


0 


sin (ax) dx, GSO 


where a is some constant (more about a, soon). Differentiating with respect to the 
parameter y (notice, carefully, that x is the dummy variable of integration), 


=| 0 oo sin a ax=| _xe—y Sin (ax) 4 
dy 0 Oy x 0 x 


or, 


d Co 
oe -| e *Y sin (ax) dx. 
dy 0 


If this integral is then integrated-by-parts twice, it is easy to show that 


dg a 
dy a? +-y” 


which is easily integrated to give 


ay) =C- tan) 


where C is an arbitrary constant of integration. We can calculate C by noticing, in 
the original integral definition of g(y), that g(00) = 0 because the e *” factor in the 
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integrand goes to zero everywhere as y — oo (because, over the entire interval of 
integration, x > 0). 


Thus, 
0=C- tan ~' (too), 
where we use the + sign if a> 0 and the — sign if a<0. So, C = +3 and we have 
pan '()) 
=xr--t =). 
e(y) = £5 — tan!(2 


The special case of y=0 (and so tan~! (2) = 0) gives us the following 
wonderful result, called Dirichlet’s discontinuous integral (after the German math- 
ematician Gustav Dirichlet (1805—1859)): 


TU . 

= eel 0) 
® sin(ax) 20 

(3.2.1) ae dx= 0 ifa=0 
0 T 

== jieie< (0) 


The value of the integral at a= 0 is zero, as the numerator of the integrand is then 
zero over the entire interval of integration, with the exception of the single point 
x =0 where the integrand has value a. Euler derived the a= 1 special case some- 
time between 1776 and his death in 1783. The plot in Fig. 3.2.1, generated by using 
quad to evaluate the integral for 1,000 values of a over the interval — 0.5<a<0.5, 
hints at the correctness of our calculations, with the all-important sudden jump as a 
goes from negative to positive dramatically illustrated (the wiggles are due to the 
Gibbs phenomenon, which is inherent in any attempt to represent a discontinuous 
function as a finite sum of sinusoids and, after all, integrating with guad is such a 
sum—see any book on Fourier series). 


3.3 Frullani’s Integral 


As yet another example of differentiating under the integral sign, let’s calculate 


dx. 


I(a,b) = [ tan ~ en) tan ~' (bx) 


Notice that I(a, a)= 0. Differentiating with respect to a (using a partial deriva- 
tive as I is a function of the two parameters a and b): 
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integral value 
° 


_ 


1.5 
5 04 03 02 -01 0 01 O02 O03 O4 O05 


Fig. 3.2.1 Dirichlet’s discontinuous integral 


© fie. 4 _( vi x 
a= |, (2) Files (ax) ax =| (2) fee dx 


So, integrating with respect to a, 
T 
I(a,b) = zinta) + C(b), 


where C(b) is an arbitrary function (of b) of integration. Writing C(b) in the 
alternative form of $1n(C(b))—a more convenient constant!—we have 


I(a,b) = $ In(a) 4: 5 In(C(b)) = 5 In(aC(b)). 


Since I(a, a) =0, we have aC(a) = 1 or, C(a) = +. So, C(b) = }, and thus 


eo -1 = =i - 
tan~*(ax) — tan~* (bx) Ao uin (2) . 
2 


D4 


(3.3.1) 
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If a= and b=1, for example, then 


= 1.798137... 


oO tf -1 = =1 
| an~'(ax) — tan~!(x) Ge mn(z) 
0 Xx 2 


and, in agreement, quad(@(x)(atan(pi*x)-atan(x))./x,0,1000) = 1.797461 .... 

This result is a special case of what is called Frullani’s integral, after the Italian 
mathematician Giuliano Frullani (1795-1834), who first wrote of it in an 1821 letter 
to a friend. We’ll use Frullani’s integral later in the book, and so it is worth doing a 
general derivation, which is usually not given in textbooks. Here’s one way to do it, 
where we assume we have a function f(x) such that both f(0) and f(co) exist. Our 
derivation starts with the definition of U as (where a is some positive constant) 

h/a 
ie | f(ax) — f(0) re 
0 x 


where h is some positive constant (for now h is a finite constant, but in just a bit we 
are going to let h— oo). Replacing a with b, we could just as well write 


ge i f(bx) — £(0) 


0) x 


(To see that these two expressions for U are indeed equal, remember that a is an 
arbitrary constant and so it doesn’t matter if we write a or if we write b.) So, 


f° f(ax) ae tt rol dx 
0 x 0 
and 
ft BOR) ee u+Kof Be 
0 x 0 


Subtracting the last equation from the preceding one, 


ine f(ax) Ae a f (bx) e=66) ia dx ie dx] _ rol I ax 


Vee Lag 0 X Jo x h/b X 
0){In(x)} [ye =F coin) = covn(2), 


h/a f(b 
Then, subtracting and adding | Hoy) 
h/b X 


dx to the initial left-hand-side of this last 


equation, we have 
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P f(ax) es ig f(bx) ae r f (bx) a+" f(bx) co r(0)in(2) 


0 x 0 x h/b X h/b X 


or, combining the second and third terms on the left, 


i Cs dx [- Hee) dx + ie sls dx = f(0)In (2) 


0 xX 0 x h/b X 


or, 


f * flax) = (bx) r OX) ax = £(0)In (?). 


0 x h/b X 
Now, imagine that h — oo. Then the upper limit on the left-most integral — oo, 
and both limits on the second integral — oo. That means f(bx) — f(co) over the 


entire interval of integration in the second integral and so 


h/a f(b h/a d 
| iu lim, -cf(0)| ae 


h/b X h/b X 
b 
= f(oo)In{ —). 
(co)in() 


This all means that our last equation becomes, as h— oo, 


r ce ax + A(o0)In(2) - comn(S) 


or, writing In (2) =-In (2), we have our result (Frullani’s integral): 


b 
f(co)limp,_,..In (7) 
a 


(3.3.2) eR AOD dx = {f(00) — £(0)}In (2). 


0 


This result assumes, as I said before, that f(x) is such that both f(co) and f(0) exist. 
This is the case in the first example of f(x) = tan” ‘(x), and f(x) =e * works, too, as 
then f(0) = 1 and f(co) = 0 and so 


(3.3.3) 
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But not every f(x) meets this requirement. 
For example, can we calculate 


°° cos (ax) — cos (bx) ae 


I(a,b) = | 


0 xX 


using Frullani’s integral? No, because here we have f(x) =cos(x) and so while 
f(0) =1 exists, f(0o) does not (the cosine function oscillates endlessly between 
—1 and +1 and has no limiting value). What we can do, however, is calculate 


we ig = cos (ax) — cos =) ae 


0 xX 


and see what happens as t— 0. Ill defer doing this calculation until the next 
section, where I'll first show you yet another neat trick for doing integrals and 
then we’ll use it to do I(t). Interestingly, it turns out to be sort of the ‘inverse’ of 
Feynman’s trick of differentiating under the integral sign. 


3.4 The Flip-Side of Feynman’s Trick 


I'll demonstrate this new trick by using it to calculate the value of 


°° cos (ax) — cos (bx) ae 


I(a,b) = | 


0 x? 


We can write the integrand of this integral as an integral, itself, because 


dy. 


cos (ax) — cos (bx) * sin (xy) 
x2 - i Xx 


This works because the integral, when evaluated (remember, the integration is 
with respect to y and so the x can be treated as a constant), is 


“sin(xy), If? 1 f{ cos(xy)|)a _ cos (ax) — cos (bx) 
erate | eke | 


; gi 
“ah sin (xy)dy 7 7 2 


b 


So, 


a 


1,b) = -[ [Ray dx. 
b 


xX 


This may look like a (huge!) step backward, as we now have a double integral to 
do. One thing you can do with double integrals that you can’t do with single 
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integrals, however, is reverse the order of integration. Of course we might run into 
objections that we haven’t proven we are justified in doing that but, remember the 
philosophical approach we are taking: we will just go ahead and do anything we 
please and not worry about it, and only when we are done will we ‘check’ our 
formal answer with quad. So, reversing, 


11) =-[ { [2a bay, 


Now, recall our earlier result, the discontinuous integral of Dirichlet in (3.2.1): 


5 ife>0 


dx= 0 ifc=0 
T 
—.if 0. 
o c< 


In the inner integral of our double integral, y (taken as positive) plays the role of 
c and so 


a 


(a,b) =—[ 5 ay 


and so, just like that, we have our answer: 


f° costes) = cost) gy 


(3.4.1) 2 


tb 2) 


If a=0 and b=1, for example, then 


[° 1 — cos (x) 


0 x? 


dx =7 = 1.57079... 


and quad agrees: quad(@(x)(1-cos(x))./x.12,0,1000) = 1.57073 .... ‘More’ dramat- 
ically, if a= /2 and b= 3 then our result says the integral is equal to 
£(/3— V2) = 0.499257 ..., and again quad agrees as quad(@(x)(cos(sqrt(2) 
*x)-cos(sqrt(3)*x))./x.42,0,1000) = 0.498855. . .. 

Flipping Feynman’s differentiating trick on its head and integrating an integral is 
a useful new trick, applicable in many interesting ways. For example, recall from 
earlier the result 
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oF 9 1 
| e* dx =-vn. 
0 2 
Change variable to x = t\/a (and so dx = ,/a dt) and thus 


ee 1 
| e8 Vadt = 5 VE 


0 


or, 


i, ego. 
0 2Va 
Now integrate both sides of this with respect to a, from p to q: 
q Co . q 
| {| eat ar} a= | VE ots 
p 40 P 2V/a 
1 Ida 1 


= 58 | = 3vE eval = valva- vB). 


Reversing the order of integration in the double integral, 


ov) q ‘ oe) e7a e oo @-P C _—e4 e 
CUferra}a f(a fete 
0 lp 0 t B 0 t 


or, finally, 


fo ac= ve (/a - yp). 


(3.4.2) 


With p= 1 and q=2 the integral is equal to /x (V2 — 1) = 0.73417 ..., and 
quad(@(x)(exp(-(x.42))-exp(-2*(x.42)))./x.42,0,20) = 0.73416 .... 
As another example of the technique, suppose you were faced with evaluating 


1 a_q 
| ae a> 0. 
o In(x) 


We can do this by first observing that the integrand can be written as an integral 
as follows: 
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a a ; a yln(x) ealn(x) | x? | 
Yaya [{ emg -| vinx) gy — J° a _ 
ie y ie y= Je ay = tag f° = ag) 7 ae 


So, 


i x2] F i | vd ; 
— SK Xx Xx 
9 In(x) ie : 


or, upon reversing the order of integration, 


1 a_i] a 1 a y+l a 1 
[3 ax =| {| wv axbay =| {2 Vingy= | ay, 
o In(x) 0 Jo oly+1 oytl 


Making the obvious change of variable u= y+ 1, we have 


atl 


1 x? — ] 
|, ine) dx = In(u) i 


or, at last, we arrive at the very pretty 


1lya _ 


(3.4.3) ne) dx =In(a+1), a20. 


1 


1 
For example, | dx = In(2) = 0.693147...and 
o In(x) 


1? 1 
dx = | = 1. 12.654. 
ip inte) x = In(3) 0986 


In agreement, guad(@(x)(x-!)./log(x),0,1) = 0.693139 ... and quad(@(x)(x.2- 
1)./log(x),0,1) = 1.098604 .... 


From this result we can write 


I ya — xb [eo (ee 
————— dx = dx dx = In(a+ 1)—In(b+ 1 
ere o Ings) “*~ Jo In) ea ae) 


and so 
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(3.4.4) 


Now that we’ve seen how integrating under the integral sign works, let’s return 
to the integral I didn’t do at the end of the previous section, 


(i) = f 6 (= (ax) — cos ) 


0 Xx 


Notice that we can write the portion of the integrand that is in the braces as an 
integral: 


sin (xs)ds. 


cos (ax) — cos (bx) [ 


x a 


Thus, 


I(t) = |" afl sin (xsjas} dx 


or, upon reversing the order of integration (note, carefully, that since we are going 
to the x-integration first we have to bring the exponential factor into the inner 


integral, too) we have 
b oo 
I(t) = | {| e ™ sin osx} ds. 
a 0 


From standard integration tables we find 


e ™ {ssin (xs) — scos (xs) } 
i? 9? 


| e “sin (xs)dx = 


and so 


+s ese 


ee f = {s sin (xs) — scos ay ig [ Sas. 


a 


d 
Making the change of variable u=t? + s* (and so ds = 5) gives 
S 


+b" +b? 2 2 
d 1 d 1, /t+b 

10) = | a | i 
P4a2 u \2s 2 Jes U 2 vta2 


or, at last 
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(3.4.5) I(t) = ie ea i Fa é a . 


x t?2 + a2 


And so, as t— 0, we find 


co cos(ax) — cos(bx) b 
(3.4.6) 0 oer ee =In (7) a 


If b=2 and a= 1 the integral equals In(2) = 0.693147 ... and agreeing is quad 
(@(x)(cos(x)-cos(2*x))./x,0,1000) = 0.6935 .... Notice that if either a or b is zero 
the integral blows-up. That is, 


|" 1 — cos (x) dx 


0 x 
does not exist. 


A twist on the use of integral differentiation is illustrated with the problem of 
calculating integrals like 


i {In(x) }?dx 
i Vx{In(x) }7dx. 


A trick that does the job is to introduce a parameter (I'll call it a) that we can 
differentiate with respect to and then, if we set that parameter equal to a specific 
value, reduces the integral to one of the above. For example, consider 


I(a) =| x*{In(x) }?dx, 


0 


which reduces to the above first integral if a= 0 and to the second integral if a = 5. 
So, differentiating, 
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di odfi ipa dj! 
Tan a oe Min) = | tt) {in(x) Pax 


= | e!() In(x) {In(x) }?dx = | x*{In(x) dx. 
0 0 


Now this may look as though we’ve just made things worse—and we have! 
But—it also should give you a hint on how to turn the situation around to going our 
way. Look at what happened: differentiating I(a) gave us the same integral back 
except that the power of In(x) increased by 1. This should nudge you into seeing 
that our original integral can be thought of as coming from differentiating i In 
(x)dx, with that integral in turn coming from differentiating { }x“dx, an integral that 
is easy to do. 

That is, 


1 d 1 d a+1 d 1 1 
| x'in(x)dx = © | x"dx = — {2 Mi = ( ) = a 
0 da Jo da|la+1 da \a+ 1 (a+ 1) 


Thus, 


Ys 2, 4 “gals 2 1 _ (a+1) 
[.€in(3)} a= >| In(x)dx = \. 


(a+1)?{  (a+1)* 


or, 


lt 
(3.4.7) I x*{In(x)}* dx = 


2 
(a+1)3 © 


So, for a=0 we have 


i {In(x)}*dx = 2 
0 


and, in agreement, quad(@(x)log(x).42,0,1) = 2.000009. .... And for a = 5 we have 
the integral equal to y = 3 = 0.5925925 ... ; in agreement, quad(@(x)sqrt(x). 


*log(x).42,0,1) = 0.592585. . .. 
As the final examples of this section, let’s see how to do the integrals 
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I(a) = | In{a + bcos (x)} dx 
0 
where a > b> 0, and 


y= { In{1 + bcos (x) ay 


0 cos (x) 


where 0 <b< 1. The analysis will be a two-step process, with the first step being 
the evaluation of the derivative with respect to a of I(a), that is, the integral 


dl " 1 d 
= xX 
da Jy a+bcos (x) 


where a > b> 0. For this integral, change variable to z = tan (3). Then, as shown 
back in Chap. 2 (in the analysis leading up to (2.2.3)), we established that 


_ 2 
cos (x) = 
and 
2 
dx = ——~ 
K= 77 pe, 
and so 
% 1 ag 1 2 a d 
| —ea"-| : de = 2| : 
9 a+ bcos (x) 0 1—z* \1+2? 9 a(1+z7) + b(1 — 2?) 
ae eee 


=» dz _ =. [° dz 
Jo (a+b) + 2(a—b) a—bJo a+b | 4 
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Thus,* 


1 
(3.4.8) Enea 


Now, for the evaluation of our two integrals, starting with I(a). Differentiating 
with respect to a, we have from (3.4.8) that 


dI I 1 d Tt 
= x= ° 
da Jy a+ bcos (x) a2 — be 


So, integrating indefinitely with respect to a, 


Ka) = [ras a 


or, from standard integration tables, 
I(a) = nin{a +Va— v} +C 


where C is the constant of integration. We find C as follows: when b=0 in the 
integral we have 


and so setting this equal to our integration result (with b = 0) we have 


>The integral in (3.4.8) occurs in a paper by R. M. Dimeo, “Fourier Transform Solution to the 
Semi-Infinite Resistance Ladder,” American Journal of Physics, July 2000, pp. 669-670, where it 
is done by contour integration. Our derivation here shows contour integration is actually not 
necessary. Professor Dimeo states that contour integration is “well within the abilities of the 
undergraduate physics major,” in agreement with the philosophical position I take in the Preface. 
Notice that we can use (3.4.8) to derive all sorts of new integrals by differentiation. For example, 


i 1 
suppose b= — 1, and so we have | core) dx ecr Then, differentiating both sides 


= 1 
e If, for example, a=5, this new 


with respect to a, we get | dx = : 
: o [a— cos (x)]” (a2 — 1)°? 


integral is equal to son = ro = 0.1335989 .... To check, we see that guad(@(x)1./((5-cos(x)). 


A2),0,pi) = 0.1335989. . .. 
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mn{2a} + C = aln(a) 


which tells us that C= — a In(2). Thus, 
I(a) = nin{a +Va— b*} — alin(2) 


or 


Al > |0) . 


i Infa + bcos(x)}dx=T pps 


aca) 


(3.4.9) 


If a=2 and b=1, for example, our integral is equal to 
x In{24x } = 1,959759..., and checking: quad(@(wlog(2 + cos(x)),0,pi) = 
1.959759. ... 

Finally, turning to the I(b) integral, differentiation with respect to b gives 


cos (x) 


dI _ | 1+b cos (x) = ik 1 dx 
db Jo cos(x) ~~ Jo 1 + bcos (x) 


But from (3.4.8) we have (with a= 1) 


dI T 
db VJ —b? 


So, integrating indefinitely with respect to b, we have 


I(b) =x sin~'(b) +C 


where C is the constant of integration. Since I(0) =0 by inspection of the original 
integral, we finally have our answer: 


i. In{1 + b cos(x)} 


(3.4.10) x= silie-(b). 


0 cos(x) 


If, for example, b = 3, this integral has a value of x sin ~! (4) = 1.067629 ... and 
checking, we see that quad(@(x)log(U1 + (cos(x)/3))./cos(x),0,pi) = 1.06761.... 
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3.5 Combining Two Tricks 


In this section we’ll combine the differentiation of an integral with the recursion 
trick that we used back in Chap. 2 (Sect. 2.3) to solve a whole class of integrals. 
Here we’ll tackle 


/2 1 
om din = 1,23, 6c 
j {a cos?(x) + b sin?(x)} oa 


where we’ll take both a and b as parameters we can differentiate with respect to. If 


you calculate dn and on you should be able to see, by inspection, that 
Ol, /2 2 
Oa o {a cos?(x) +b sin2(x)} 
and 
Oln [ sin 7(x) 
— n ‘ 
ob 0 {a cos?(x) +b sin2(x)}"* 
From these two results we then immediately have 
Ol, ” Ol, [ 1 P : 
=-n X = —NIp+1- 
da ob o {a cos2(x) +b sin2(x)}""! - 


Or, if we replace n with n— 1, we have the recursion 


From the boxed recursion we see that the first value of n we can use with it is 
n= phe and even then only if we already know I,. Then, once we have Iz we can use 
it to find I, and so on. But first, we need to find 


m/2 
“For n= 1, the recursion gives I, in terms of Ip, where Ip = | dx = § with no dependency on 


0 
either a or b. That is, Sta — Sto = 0 and the recursion becomes the useless, indeterminate I, = QTp. 
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/2 1 /2 a8) 
= dx = EOS Es 
; \ a cos?(x) +b sin2(x) . j a+b tan?2(x) . 


Changing variable to y = tan(x), we have ay = ey or, dx = cos?(x) dy. Thus, 


1 
oo ~~ cos2(x) 1% 1 1 b — 
n=| —— cos”(x) dy = | dy = tan! } /@) oly 
0 4 +by? b 0 a Lr b a b 0 
b 
= tan="(o0) 
= — tan CO 
Vab 
or, 
1/2 1 
= #8 
eow) O acos?(x) + b sin?(x) 


To find I5, we first calculate 


) —2nvVbha? 7 ) 2 


Ca 4ab 


and 


Ol, | ~2n/alb? _ (2) fe 


Ob dab 


Thus, using the boxed (unshaded) recursion with n= 2, 


b=a— ee “| = (2)°** 
>~d4ab|Va' Vb} \4ab/ ab 


or, 


_ u/2 1 = T Ly 
= Ih {a cos2(x) + b sin2(x)}? dx = OR a a 


(3.5.2) 
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We can repeat this process endlessly (although the algebra rapidly gets ever 
grubbier!), and I'll let you fill-in the details to show that the recursion (with n= 3) 
gives 


1/2 1 = 
3 j {a cos*(x) + b sin?(x)}8 aS =, (5 amas 


(3.5.3) 


To check this (as well as the results we got earlier, since a mistake earlier would 
show-up here, too), if a= 1 and b=2 then]; = iaR= 0.65949. . .. Using MATLAB 
directly on the integral, quad(@(x)1./((cos(x).2 + 2*sin(x).42).43),0,pi/2) = 
0.65949. ... 

As a final example of recursion, consider a generalized version of the integral 
that appeared in the first section of this chapter, in (3.1.2) and (3.1.3): 


In(y) = | = 


geen): 


Earlier, we had the special case of y = 00. We can use recursion, combined with 
integration by parts, to evaluate this more general integral. In the integration by 
parts formula let 


1 
Ge ey 
and dv = 1. Then obviously v = x and you can quickly confirm that 


2X 


n+l dx. 


du = —n ——_____. 
(x? + 2) 


Thus, 


Xx Y 2x? dx 
Ih = Soa SA sd + a| —————qx« 
(y) fiz + a’) hy 0 (x? +4 a2)ntl 


or, as 2x7 = 2(x? + a’) — 2a”, we have 


I,(y) = y ae ih 2(x? + a”) dx 23° dx | 


Grey [lo Gear Jo Ge Hay 


or, 
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= y 2 
In(y) = (tay + 2nI,(y) — 2na Tha (y) 


and so, finally, we arrive at the recursion 


y 2n-1 


In+1(Y) = - In) - 


2na?(y2 +a?) " ~— 2na? 


(3.5.4) 


We start the recursion in (3.5.4) with 


y dx Li f®\yy 1. _isy 
hy) =| a a aa (le =; tan (%). 


and so for the case of y= oo we have I,(y) = 4. Then, as 


2n—1 
Ti+1 (00) = nad In(oo): 
we have 
1 I 
Taco) = gap loo) = a3 
and 
3 3n 


I3(co) = Ja 26) = l6a> 


which are exactly what we calculated in (3.1.2) and (3.1.3), respectively. And a new 
result that we didn’t have before is 


oe dx 5 15x 
soo) I (x?+a2)* 6a? (00) = 96 q7 


As a check, if a= | the value of I4(00) is 0.490873. .., and quad(@(x)1./(x.A2 + 
1).44),0,100) = 0.490874. . .. 
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3.6 Uhler’s Integral and Symbolic Integration 


This chapter celebrates Feynman’s association with ‘differentiation under the 
integral sign,’ but of course the technique greatly pre-dates him. As his own 
words at the end of Chap. | make clear, he learned the method from a well- 
known textbook (the 1926 Advanced Calculus by MIT math professor Frederick 
Woods (1864—1950)), and the method was popular among mathematicians and 
physicists Jong before Feynman entered the picture. For example, in the October 
1914 issue of The American Mathematical Monthly a little challenge problem 
appeared, posed by a Yale physics professor named Horace Scudder Uhler? 
(1872-1956). There he asked readers how they would evaluate the double integral 


a atx .—-Cc 
l= | (a? _ =) x ax a dy, 
0 y 


which had occurred while “in the process of solving a certain physical problem.” 
The values of a and c are positive. 

Uhler actually already knew how to do it—he even included the final answer 
when he made his challenge—but he was curious about how others might approach 
this double integral. A solution from a reader was published in the December issue, 
and finally Uhler showed (in the January 1915 issue, more than 3 years before 
Feynman was born) how he had done it, by differentiation with respect to the 
parameter c. Here’s what he wrote: “Differentiate I with respect to the parameter c, 
then 


dl a a+x 

= | ee — x) x ax] e dy, 

which can be evaluated at once [I think this “at once” is just a bit misleading as, 
even using standard integration tables, I found the routine algebra pretty grubby] 


and gives 


dl 2a" 6a 6 (= 6 nm ose 
de ch ct © ct Oe , 
We can now integrate both sides of this equation [for a condition to determine 
the constant of integration, notice that I(0o) = 0 because the integrand of the inner 
y-integral goes to zero as c — oo], thus [and then Uhler gives the answer] 


> Uhler was a pioneer in heroic numerical calculation, made all the more impressive in that he 
worked in the pre-electronic computer days. His major tool was a good set of log tables. I describe 
his 1921 calculation of, to well over 100 decimal digits, the value of (v - iy = ein my book 
An Imaginary Tale: the story of ’—1 , Princeton 2010, pp. 235-237. 
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1 2 3a | 1 3 —2ac ” 
1=3|: : -r(a+z)( e )}. 


We can make a partial check of this as follows. For the case of a= 1 andc= 1, 
for example, Uhler’s formula becomes 


I= ji-34 (143) ae) = -2+3 (1-67) = 016166179 0 


MATLAB (if accompanied by Symbolic Math Toolbox) can numerically eval- 
uate (with double precision) Uhler’s double integral directly as follows for these 
particular values of a and c, where the symbols x and y are first declared to be 
symbolic quantities: 

SYMS X y 

double(int(int(-x42)*x* exp(-y)/y,y,1-x,1 + x),x,0,1)) 

The computer result is in outstanding agreement with Uhler’s formula: 
0.16166179 ..... The reason why Uhler’s formula and MATLAB’s integration 
are in such good agreement is that the nested int (for ‘integrate’) commands actually 
perform symbolic integrations, resulting in the exact answer of -5/2*exp(-2) + 1/2. 
The final command of double converts that exact symbolic answer into double 
precision numerical form. 

The syntax for the use of nested int commands to symbolically evaluate multiple 
integrals should now be obvious but, just to be sure, here’s a teaser. You may recall 
that at the end of the Preface I mentioned something called the ‘Hardy-Schuster 
optical integral.’ We’ll treat this integral analytically later in the book where, a little 
ways into the analysis, we’ll get it into the form of a triple definite integral: 


I, tl tl cos (1 — u’) at} au} ie 


Our analysis will show that this perhaps intimidating expression is equal tos /5= 
0.62665706 .... To have Symbolic Math Toolbox evaluate it, however, all that is 
required are the following two lines (where inf is the symbolic representation for 
infinity): 

syms X tu 

int(int(int(cos(t42-u2),t,x,inf),u,x,inf),x,0,inf) 

When MATLAB returns the answer, it begins by telling you that no explicit 
integral could be found, but then it prints out a rather long and cryptic expression 
that it calls ans (for ‘answer’). If you then convert ans to numeric form by typing 
double(ans) you get ....... (BIG drum roll): 0.62665706 ..... 

Isn’t that neat? 

So far I have used quad to check one dimensional integrations, and now int to 
check multi-dimensional integrations. But of course int can easily do 
one-dimensional integrals, too, if Symbolic Math Toolbox is installed on your 
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computer along with MATLAB (quad is part of MATLAB and so it is always 
available). To see int used on a one-dimensional integral, recall our result (2.1.4): 


o l+e* a 


| dx In(2) 
Differentiating with respect to the parameter a, we get 


dx = 
o (1+e%)? ar 


[° xe* _ In(2) 


dt 
Now, change variable to t=e™ and so x = 1 In(t). This means dx = of and thus 
a 


[ +In(t)t (<) _ In(2) 

1 (1+t) \at)/ a 

or, after cancelling the a’s and t’s and changing the dummy variable of integration 
back to x, 


fe 2@. dx = In(2). 


(3.6.1) ae 


Invoking the Symbolic Math Toolbox, we can check this result by writing 
SYMS X 
int(log(x)/(Z + x)42),x,1,inf) 
which returns the exact symbolic result of: 
ans = log(2). 


Or, for another one-dimensional example, recall the aerodynamic integral from 
the Introduction, 


The Symbolic Math Toolbox agrees, as 
SYMS X 

int(sqrt( + x)/U-x)),x,-1,1) 

produces the exact symbolic result of: 


ans = pi 


while quad(@(x)sqrt(U + x)./U-x)),-1,1) = 3.14159789 . . . (the actual numerical 
value of pi is, of course, 3.14159265 ...). 

As one more example of the Symbolic Math Toolbox, recall the second chal- 
lenge problem from Chap. 1, where you were asked to show that 


3.7. The Probability Integral Revisited 105 


od 
| 4. 
1 vx3-1 
With the Symbolic Math Toolbox we can get a far more precise value for this 
integral: 
SYMS X 


double(int(1/sqrt(x3-1),1,inf)) = 2.42865. . .. 


3.7. The Probability Integral Revisited 


In footnote 1 of this chapter I promised you some more discussion of the probability 
integral 


To start, Pll derive it again but in a different way (but still using differentiation 
under the integral sign). Let 


and further define f(x) = (| 
0 
Then, 


and 


dg i —2x(1+ Pe (H4") 


1 
dt = 2| xe (4) at 
dx 0 1+ t2 0 


1 1 
= -2x| e*e* dt = —2xe*| edt. 
0 0 


Let u = tx (which means du = x dt) and so dt = du Thus, 


d 2{* d _ df 
= —2xe * | ew aus -2*| edn = 
dx 0 X 0 dx 
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So, 


df dg 


dx dx 


or, with C a constant, we have f(x) + g(x) =C. 
In particular f(0) + g(0) =C, but since f(0) = 0 and since 


we have C = §. That is, f(x) + g(x) 
But that means f(0o) + g(co) = 


7 and since f(oo) = P and g(co) =0 (because 
the integrand of the g(x) integral — 0 as x — oo) then 


x 
a 


P=-. 
4 
That is, 


Oe og? 1 
I= | e* dx ==/n 
0 2 
or, doubling the interval of integration, 
| eo dx = Vn. 


Now, let x = i (and so dx = %)- Then, 


re 2 or w du 
e *dx= e ?—==Vn 
ie [. V2 a 


or, as we derived in (3.1.4), with the dummy variable of integration changed 
back to x, 


| eadk = v2n. 


Now, to complete this chapter’s discussion of the probability integral, let’s 
derive yet another generalization of it, one first done by the French mathematician 


Pierre-Simon Laplace (1749-1827) 200 years ago. What we’ll calculate is the 
integral 
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ee 2< bs 
I= | e “dx, 
0 


and in particular we see that 2I reduces to the probability integral for a = 5 and 


b=0. 
To start, let t = Xy/a. Then, dx = & and so 


where 
b= | et Bat 
0 
Next, define 
Vab 
a 
Then 
dy vab_ Vab | y- 
dt 2 ? /ab 
or, 


tee 
So, as ab = yt? we have 
0 lore) -y’- ab 
_a d 
ie =| ae ie (-vae =) = vab| Say 
fore) y 0 y 
Thus, 
fore) oo 3? ab 
2 ab t 
2) = | ef” edt+ vab| zat 
0 0 


or, 
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2h = | ate ®) ' Pha 
0 t 
Now, change variable again, this time to 
vVab 
s=t—-— os . 
So, 
d Vab 
a 1+ ees 
dt 1? 
or, 
d 
oo 
1+ “ee 
‘ ee) ab : 
Then, since s“ = t“ — 2Vab + p we have (notice that s = — co when t=0) 
ob — Ei est avab J yy vab ds 
a 2 1 vab 
es + 
or, 
1 : —2Vab lore) 
= | eo -2vabgs — © | e* ds 
and so 
L= | eds 
0 
Now, since I = WAL then 
S aged: 1 oe 2 
I= | e dx = se | e * ds, 
0 va 0 


and since 
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we then have the beautiful 


(3.7.1) 


To numerically check this result, for a=b=1 the integral is equal to 2 = 
0.11993777... and in agreement we have quad(@(x)exp(-(x.42) + 1./@. 
A2))),0,10) = 0.119939... 


3.8 Dini’s Integral 


To wrap this chapter up, let’s work our way through a logarithmic integral with 
important applications in mathematical physics and engineering, one first evaluated 
in 1878 by the Italian mathematician Ulisse Dini (1845-1918). It is 


I(a) = | In{ 1 — 2acos (x) + a? dx 


where the parameter « is any real number. Notice that since cos(x) runs through all 
its values from —1 to +1 as x varies from 0 to m, we see that the sign of is 
immaterial, that is, (a) = I(lal). So, from now on I’Il discuss just the two cases of 
O0<a<landa>l. 

Differentiating, we have 


dI * —2cos (x) + 20 1” 1-— 
= dx = 1 dx 
da Jo 1 —2acos(x) +e? a Jo 1 — 2acos (x) + a? 
ae i 1— a? 
= dx. 
a Jo 1 — 2acos (x) + 02 


Next, make the change of variable z = tan (5) which means, as we showed back 


in Chap. 2 (see the analysis leading up to (2.2.3)), that 


and 
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Thus, 


dl a an 1—? 2 4 
= Z 
da a ajo 1—2a +o2 \14 2? 


1-22 
14-22 
st cess dz 
a a 9 1+z? —2a(1—z?) + 0?(1 427) 


which becomes, with just a little algebra, 


dl x (=) (; - an dz 
= 5 : 
da « a/ \1+ a Jo (5 :) fn 


This integrates as follows: 


dl nw 2/1— a\ 1 if z oo 
= tan aston 

da a allt op F4 reas 
1 1+ o 00 

=== 2tan~* 


If a>1, then 1+a>0 and 1—a<0O which means 


i+* <0 and therefore 
tan! (}+“z)|* = —% and so 
dI By Qn 
seer ee 
da a [x 2. a oe 


If 0<a<1, however, then 1+a>0 and 1—a>0O and so t+4>0 and 
therefore tan! (t+ -&7)|* = ae and so 


Now, since 


then 
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dl 
—=0,0<a<l 
da 


integrates by inspection to 
I(a) =0,0<a<l. 


To integrate at — 2n for a> 1 we need to get a specific value of I(a«) for some 
a > | in order to evaluate the constant of integration. Alas, there is no obvious value 
of « that leads to a ‘nice’ integral to evaluate (like we had for I(0))! Fortunately 
there is a clever trick that will get us around this difficulty. What we’ll do is first 


pick a value (call it B) such that 0 < B < 1, which means 


I(p) = xe — 2B cos (x) + B?}dx = 0 


0 


by our previous argument. Then, we’ll pick the specific ~ value we’re going to use 
to be a = 7 which will, of course, mean that « > 1. That is, 


I(p) =0= (2) = [mn 1 ~2- cos(x) + dx 


0 


dx 


ft a? —2acos(x) + 1 
0 a? 


= | Inf{a* — 2acos (x) + 1 }dx — fs In{a? }dx 


0 
= | In{a* — 2acos (x) + 1}dx — | 2Infa}dx 
0 0 


which, recall, equals zero (look back to where this line of math starts: I(B) = 0 = 
I(4)). That is, when « > 1 we have 


[ Inf{o? — 20 cos (x) + I}dx = [ 2In{a}dx = 2infap | dx = 2nln{a} 
0 0 0 


and we see, in fact, that this is indeed in agreement with gt = 2n fora>1. 
So, 


00<a<1 
I(a) = 
2nln{a},a > 1 


as well as I(«) = I(lal). The easiest way to write all this compactly is 
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Ona <1 
Ie In{1 — 2a cos(x) + a?} dx = 


Tintact, ae ll 


(3.8.1) 


To check, for 0 = 5 for example, we have quad(@(x)log((5/4)-cos(x)),0,pi) = 
1.127x 1077 (pretty close to zero), and for « = 2 we have quad(@(x)log(S-4*cos 
(x)),0,pi) = 4.3551722... while x In(2”) = 2m In(2) = 4.3551721.... 


3.9 Feynman’s Favorite Trick Solves a Physics Equation 


In a physics paper published® several years ago, a classic problem in mechanics was 
given an interesting new treatment. The details of that analysis are not important 
here, just that once all the dust had settled after the physics had been done, the 
author arrived at the following equation to be solved: 


o 
(3.9.1) V7() = V7(0) + 2{ cos (fp) — psin()} — an] V7 (x)dx. 


In (3.9.1) p is a non-negative constant, and v7(0) is also a constant (it is, of 
course, the value of V*(o). when @ = 0). The goal is to solve (3.9.1) for V*() asa 
function of ¢, 1, and v7(0). 

Once he had arrived at (3.9.1) the author wrote “[This] is a Volterra [after the 
Italian mathematician Vito Volterra (1860—1940)] integral equation of the second 
kind, for which the solution is straightforward.” He didn’t provide any solution 
details; after referring readers to a brief appendix, where he cited the general 
formula for the solution to such an equation (in general, integral equations can be 
difficult because the unknown quantity to be found appears both inside and outside 
an integral), he simply wrote down the answer. Using this formula allowed “the 
solution [to be] found straightforwardly, albeit laboriously.” Now, in fact he was 
perfectly correct in declaring the solution to be “straightforward,” but there really 
isn’t anything that has to be “laborious” about solving (3.9.1). That is, there doesn’t 
if you know how to differentiate an integral. 

So, differentiating (3.9.1) with respect to d using (3.1.1), we have 


© Waldemar Klobus, “Motion On a Vertical Loop with Friction,” American Journal of Physics, 
September 2011, pp. 913-918. 
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dv*(o) 
do 


= 2{—sin (¢) — pcos()} — 2nV2(6) 
or, rearranging, we have the following first-order differential equation for V7(¢): 


dV?() 
dp 


(3.9.2) + 2pV7() = —2{ sin (fp) + pcos(¢) }. 
Next, we multiply through (3.9.2) by e?? to get 
2 
Ae + 2uV2()e2" = —2{ sin () + woos()}e™, 


This is useful because the left-hand-side is now expressible as a derivative, as 
follows: 


(3.9.3) a {V*(p)e7#?} = —2{ sin () + pcos(p) }e?. 


This last step is, in fact, an application of a technique routinely taught in a first 
course in differential equations, called an integrating factor (the e*#® is the factor). 
And that is our next step, to integrate (3.9.3) from 0 to ¢: 


oq $ 
| dx {V?(x)e# bdx = -2| { sin (x) + pcos(x)}e7*dx. 
: 0 


The left-hand-side is 


= V7(p)e** — V*(0), 


and so 
v 
V?(p)e7#? = V7(0) — 2| { sin (x) + picos(x) }e7#*dx 
0 
or, 


(3.9.4) V7(p) = e 7#°V2(0) — 2" { sin (x) + pcos(x)}e7/*dx. 
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Both of the integrals on the right-hand-side of (3.9.4) are easy to do (either 
by-parts, or just look them up in a table of integrals) and, if you work through the 
details (which I’ll leave to you), you’ll arrive at 


ea 2(2? — 1) 
AO nO) ara 
(3.9.5) te [3p sin () + (21° — 1) cos ()] 


14 4p? 


which is, indeed, the solution given by the author of the physics paper, and so we 
have yet another success story for ‘Feynman’s favorite trick.’ 


3.10 Challenge Problems 


(C3.1): Treat a as a parameter and calculate 


© In(d D2 

| n( = a°x*) re 
0 b* + x2 

where a and b are positive. If you look back at (2.4.3) you'll see that this is a 


generalization of that integral, for the special case of a= b = 1. That is, your answer 
for the above integral should reduce to xz In(2) if a=b=1. 


(C3.2): Calculate the Cauchy Principle Value of 
| °° cos (ax) 


pee dx,a > 0,b > 0. 
—~oo —xX 


Hint: make a partial fraction expansion, follow that with the appropriate change 
of variable (it should be obvious), and then finally recall Dirichlet’s integral. 


(C3.3): In (3.1.7) we found that 


| cos - cae en 
0 x2+b 2b 


Combine that result with your result from the previous challenge problem to 
calculate 


dx. 


[ cos (ax) 


x bt —x4 
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(C3.4): Show that the Cauchy Principle Value of 


| ee ms cos (ab). 
0 x*—b 2, 


Again, don’t forget Dirichlet’s integral. 


(C3.5): Since we are using Dirichlet’s integral so much, here’s another look at 
it. Suppose a and b are both real numbers, with b > 0 but a can have either sign. 
Show that: 


, lal<b 


v1 

2 
——dx= 0, |aJ>b. 

lal=b 

4 


(C3.6): I’ve mentioned the “lifting theory” integral several times in the book, and 
told you its value is 7, MATLAB agrees with that and, indeed, I showed you the 
indefinite integration result in Chap. 1 (Sect. 1.7) that you could confirm by 
differentiation. See if you can directly derive the specific case 


1 

1 

| i = dx = a. Hint: try the change of variable x = cos(2u), and remember 
—1 —xX 


the double-angle identities. 


(C3.7): Here’s a classic puzzler involving double integrals for you to think about 
(since we touched on double integrals in Sect. 3.6). A standard trick to try on double 
integrals, as I discussed in Sect. 3.4, is to reverse the order of integration, with the 
idea being the order of integration shouldn’t matter but maybe one order is easier to 
do than the other. That is, the assumption is 


[ {f' f(x,y) ax bay = [ {{ f(x, y) ay hax 


‘Usually’ this is okay if f(x,y) is what mathematicians call ‘well-behaved.’ But 


it’s not always true. If, for example, a=c=0 and b=d=1, and f(x,y) = aay” 


then the equality fails. Each of the two double integrals does indeed exist, but they 
are not equal. Show that this is so by direct calculation of each double integral. Any 
idea on why they aren’t equal? 


(C3.8): Show that 


and that 
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| We * dx = ; nv/e. 


—oo 


OO 
Hint: Consider I(a, b) = | oo de, complete the square in the exponent, 


make the obvious change of variable, and recall (3.7.1). Then, differentiate I(a, b) 
with respect to a and with respect to b, and in each case seta=1 andb=— 1. 
(C3.9): Given that | ee dx = (+) for a >0, m > 0—later, in Chap. 8 


(in Challenge Problem 8.2), you’ll be asked to derive this result using contour 
integration—differentiate with respect to the parameter a and thereby evaluate 


| nn a Hint: If m=a=1 then your result should reduce to 
0 x(x? +a?) 

E(1 - +) = 0.70400..., and MATLAB agrees: quad(@(x)sin(x)./(x.*((x.2 + 1). 
42)),0,1000) = 0.70400. . .. 


(C3.10): Despite Feynman’s enthusiasm for the technique of differentiating inte- 
grals, he certainly did use other techniques as well; his famous 1949 paper (see note 
7 in Chap. 1), for example, is full of contour integrations. And yet, even there, he 
1 
returned to his favorite trick. Recall his integral k = | = . Ina note at 
a 9 [ax + b(1 — x)] 
the end of the 1949 paper Feynman observed how additional identities could be 
1 


x dx 


easily derived from this integral, such as 5 = | 

o [ax + b(1 — x)] 
his original integral with respect to a, and so confirm this second integral. (While a 
good exercise—and you should do this—it is so easy I’ve not bothered to include a 
solution at the end of the book.) 


re Differentiate 


(C3.11): As I said in the text, integral equations can be very tough to solve. Here’s 
another one that is just a bit more challenging than is (3.9.1) but, still, it can 
be solved using only math at the level of this book. Specifically, for p(0)= 1 
solve p(x)(x) = J 2p(u)du for p(x) as a function of the given function (x), and 
thus show that 
* du 

In{p(x)} = In{(0)} — In{b()} — |e 
ability book Will You Be Alive Ten Years From Now? Princeton 2014, and you can 
find the solution there on pp. 170-172. 


. This problem occurs in my prob- 


Chapter 4 
Gamma and Beta Function Integrals 


4.1 Euler’s Gamma Function 


In two letters written as 1729 turned into 1730, the great Euler created what is 
today called the gamma function, I'(n), defined today in textbooks by the integral 


(4.1.1) T(n) =| etx dx, 10. 
0 


This definition is the modern one (equivalent to Euler’s), dating from 1809, and 
due to the French mathematician Adrien-Marie Legendre (1752-1833). For n= | it 
is an easy integration to see that 


r(1) = ie e* dx = {-e*} |> = 1. 


Then, using integration by parts on 


ria+t)=| e * x" dx, 
0 


where we define u=x" and dv=e* dx (and so du=nx" ‘dx and v=—e ~ ), 
we get 


T'(n + 1) = {—x"e“*} les +| e* nx"! dx = n| engl de 
0 
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That is, we have the so-called functional equation for the gamma function: 
(4.1.2) T(n+ 1) =nI(n). 


So, in particular, for n a positive integer, 


(2) =1eI(1)=1lel=1, 
T(3) =2eI(2) =2e1 =2, 
T(4) =3 eI(3) =302=6, 
T(5) =4eI(4) =406= 24, 


and so on. In general, you can see that for positive integer values of n 
T(n+ 1) =n! 

or, equivalently, 

(4.1.3) T(n) =(n—-1)!, n> 1. 


The gamma function is intimately related to the factorial function (and this 
connection was, in fact, the original motivation for Euler’s interest in I’(n)). 

The importance of the functional equation (4.1.2) is that it allows the extension 
of the gamma function to all of the real numbers, not just to the positive integers. 
For example, if we put n=—5 into (4.1.2) we get I'($) = —3I(—}) and so 
T(—4) =—2r(4). We'll calculate (4) to be \/z later in this chapter, and thus 
I'(—4) = —2\/x. We can use this same technique to extend the values of P(n) for 
positive values of n (as calculated from the integral in (4.1.1)) to all the negative 
numbers. The gamma function can be extended to handle complex arguments, as 
well. When we get to Chap. 8 I'll show you how Riemann did the same sort of thing 
for the zeta function (to be defined in the next chapter). Riemann’s functional 
equation for the zeta function extends (or continues) the zeta function’s definition 
from all complex numbers with a real part greater than 1, to the entire complex 
plane. That, in turn, has resulted in the greatest unsolved problem in mathematics 
today. Exciting stuff! But that’s for later. 

Equation (4.1.3) is particularly interesting because it shows that, contrary to 
the initial reaction of most students when first encountering the factorial function, 
0!0. Rather, setting n= 1 in (4.1.3) gives 


r(1)=(1-D!=0l=1. 


The gamma function occurs in many applications, ranging from pure mathemat- 
ics to esoteric physics to quite practical engineering problems. As with other such 
useful functions (like the trigonometric functions), the values of I’(n) have been 
extensively computed and tabulated. MATLAB even has a special command for it 
named (you shouldn’t be surprised) gamma. 
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As an example of its appearance in mathematics, let’s evaluate 


9° 
| e * dx. 
0 


Making the change of variable y = x? (which means x = y), and so 


dy _ dy 
) — > 
3x2 3y3. 


Thus, 


oo d 1 Wa 2 
| e * dx = | ey ul = ;| ey 3, 
0 0 B3ys 3 Jo 


This looks just like (4.1.1) with n — 1 = —3, and son = ; and we have 


| e*dx =tr Z : 
0 3. \3 


Or, using (4.1.2), 


and so 


(4.1.4) 


Using MATLAB’s gamma function, gamma(4/3) = 0.8929795... and quad 
agrees; quad(@(x)exp(—x.43),0,10) = 0.8929799.... 


4.2 Wallis’ Integral and the Beta Function 


Sometime around 1650 the English mathematician John Wallis studied the integral 
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which he could directly evaluate for small integer values of n. For example, 


and so on. From this short list of numbers, Wallis somehow then guessed (!) the 
general result for I(n). Can you? In this section we’ll derive I(n), but see if you can 
duplicate Wallis’ feat before we finish the formal derivation. 

We start by defining the beta function: 


1 
(4.2.1) B(m,n) -| x™-1(1 —x)""! dx,m > 0,n>0. 
0 


The beta function is intimately related to the gamma function, as I'll now show 
you. Changing variable in (4.1.1) to x =y” (and so dx = 2y dy) we have 
T(n) = | gry" ay dy = 2| ey yn! dy. 
0 0 


We get another true equation if we replace n with m, and the dummy integration 
variable y with the dummy integration variable x, and so 


(4.2.2) T(m) = 2| en 2m! dy, 
0 


Thus, 


lo.@) 


T(m)P(n) = 4| 


ee) 
eo® x2m-l ax| ey yn! dy 
0 


0 


= 4 | en (Hy?) x2m—1y2n—I gy dy. 
0 JO 


This double integral looks pretty awful, but the trick that brings it to its knees is 
to switch from Cartesian coordinates to polar coordinates. That is, we’ll write 
r=x+y’ where x=rcos(@) and y=rsin(@), and the differential area dx dy 
transforms to r dr d@. When we integrate the double integral over the region 
0 <x, y <oo we are integrating over the entire first quadrant of the plane, which 


is equivalent to integrating over the region 0<r<oo and 0 < 0 <5. So, 
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T(m)P(n) = af |. e {rcos (0)}°™ |! {rsin (0) }?""'r dr dO 


or, 


wha 


(4.2.3)  T(m)r(n) = Be otters af cos 2™—1(9) sin 7"-1(6)d0}. 


Let’s now examine, in turn, each of the integrals in square brackets on the right 
in (4.2.3). First, if you compare 


ae ar y2im+n) =1 dr 
0 


to (4.2.2), you see that they are the same if we associate x +r and m+ (m+n). 
Making those replacements, the first square-bracket term in (4.2.3) becomes 


2| et mn) gr = T(m +n). 
0 


Thus, 


ua 
2 


(4.2.4) T'(m)I'(n) = T(m +n) 2f cos?™-!() sin2"~!(8)d0}. 


Next, returning to (4.2.1), the definition of the beta function, make the change 
of variable x= cos7(6) (and so dx=—2sin(®) cos(®) d@), which says that 
1—x=sin’(8). So, 


B(m,n) = i x™l(y — x)?! dx = -2| cos “™~?() sin2"~?(8) sin (0) cos (0)d0 


or 


a 
2 


B(m,n) = | cos7™~!(@) sin7"~!(0)d0 

0 

which is the integral in the square brackets of (4.2.4). Therefore, 
I'(m)P(n) = ['(m + n)B(m, n) 


or, rewriting, we have a very important result, one that ties the gamma and beta 
functions together: 
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P(m)I'(n) 


(4.2.5) B(m,n) = Tongan” 


Now we can write down the answer to Wallis’ integral almost immediately. Just 
observe that 


k k 
1—x)*dx = B(kk+1,k+1) = 
(1 — x)"dx (k+1,k + 1) T(2k +2) 


i k i T(k+ 1)P(k + 1) 
or, using (4.1.3), 


kik! (kl)? 
UK) = Gea pl = Qk +I 


So, 


(4.2.6) I(n) = ae: - x2)n dx = (n!)? 


(2n+1)! ° 


If you look back at the start of this section, at the first few values for I(n) that we 
(Wallis) calculated by direct integration, you’ll see that (4.2.6) gives those same 
results. For ‘large’ values of n, however, direct evaluation of the integral becomes 
pretty grubby, while the right-hand side of (4.2.6) is easy to do. For example, if 
n=7 we have 


| (x — x)" dx = (7)" = 1.94... x10-8 
' 15! 


and MATLAB agrees, as guad(@(x)(x-x.42).47,0,1) = 1.93... xl10-°. 
One quite useful result comes directly from (4.2.6), for the case of n = $. This is, 
of course, a non-integer value, while we have so far (at least implicitly) taken n to 


be a positive integer. In keeping with the spirit of this book, however, let’s just 
blissfully ignore that point and see where it takes us. Forn = . (4.2.6) becomes the 


Oy 


Alternatively, we can directly evaluate the integral on the left using the area 
interpretation of the Riemann integral, as follows. The integral is the area under the 


curve (and above the x-axis) described by y(x) = Vx — x* from x=0 to x=1. 


claim 


1 
| Vx —x2dx= 
0 
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That curve is probably more easily recognized if we write it as y=x-x’ or, 


x x4 y- =0 or, by completing the square, as 


1\2 .y 1\2 
X—= =(-]. 
a NG 
That is, the curve is simply the circle with radius 4 centered on the x-axis at 


x= a The area associated with our integral is, then, the area of the upper-half of 
the circle, which is e So, 


or, 


(4.2.7) (5) ene 


Does (4.2.7) ‘make sense’? Yes, and here’s one check of it. Recall (4.1.3), 
T(n) = (n- 1)! 


that, for n = 3 gives ()! and so, putting n= 3 in (4.1.1) and using (4.2.7), we 


arrive at 


428) fo e*Vax = 


2 


This is 0.886226 ... and MATLAB agrees, as quad(@(x)exp(—x).*sqrt 
(x),0,100) = 0.8862228.... 
We can use (4.2.8) to establish yet another interesting integral, that of 


1 
| —In(x) dx. 
0 
Make the change of variable y = — In(x). Then, 


e elnls) eln(x"') eln() 


and since 
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we have 


dx = -—. 


Thus, 


[varm8- fs(-2) [vere 


But this last integral is (4.2.8) and so 


(4.2.9) f, v—In® dx=- Vn. 


2) 


MATLAB agrees, as guad(@(x)sqrt(—log(x)),0,1) = 0.88623. . 
ing to compare (4.2.9) with (3.1.8).) 


With our work in this chapter, we can even talk of negative factorials; suppose, 
for example, n = 4 in (4.1.3), which gives 


. . (It’s interest- 


an integral we can find using (3.7.1). There, if we set a= 1 and b=0 we have 


Oe 1 
| e* dx = 5Vt 


0 


If we now change variable to s = x” then se = 2x = 2,/s and so dx = ae That 
gives us 


or, replacing the dummy variable of integration s back to x, 
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(4.2.10) 


This is 1.77245..., and quad agrees: quad(@(x)exp(-x)./sqrt(x),0,10) = 
1.772448.... 
Thus, 


(4.2.11) r(5) = (-3): = Vr. 


Another way to see (4.2.11) is to use (4.2.4). There, with m =n = 5, we have 


r(5)r(5) =r pf a9 =r) [2(5)| =T(l)x 


or, as (1)= 1, 
and so, again, 


Together, the gamma and beta functions let us do some downright nasty-looking 
integrals. For example, even though the integrand itself is pretty simple looking, the 
integral 


Nin 


| sin (x) dx 


seems to be invulnerable to attack by any of the tricks we’ve developed up to now— 
but look at what happens when we make the change of variable u= sin*(x). Then 


du 


and, as 
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and 


RIS 


cos (x) = 1 — sin?(x) = (1 — u)?, 


we have 


; ' ow if! 1 I 
| sin (x) ax = | al - du = | wt —uytau=538(7.5). 
0 0 2u2(1 — uy)? 2Jo 2 \4’2 


From (4.2.5) this becomes (the integral on the far-right follows because, over the 
integration interval, the sine and cosine take-on the same values), 


fz (sin@) ax = We - fe cos(x) dx . 


(4.2.12) 


MATLAB’s gamma function says this is equal to gamma(3/4)*gamma(1/2)/ 
(2* gamma(5/4)) = 1.19814..., and quad agrees as quad(@(x)sqrt(sin(x)),0,pi/2) 
= 1.19813.... 

The same substitution works for 


ge 
sin(x)cos(x)  2V7 


(4.2.13) 


MATLAB’s gamma function says this is equal to (gamma(1/4)/2)/(2* sqrt 
(pi)) = 3.708149... and quad agrees: quad(@(x)1./sqrt(sin(x).*cos(x)),0,pi/2) = 
3.708170. .. 
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As another example, we can use (4.2.13) and the double-angle formula from 
trigonometry to write 


i dx 7 f dx _P 
0 \/sin(x)cos(x) Jo V3 sin (2x) Vn 


Make the change of variable u= 2x and so dx = du and thus 


I, . Foal fe = 


or, 


(via OS 
0 v/ sin (x) V2) 2/n- 

Or, finally (the integral on the far-right follows because, over the integration 
interval, the sine and cosine take-on the same values), 


TT 
2 


ie MG) Q dx 


(4.2.14) (Gn 


0 J/cos(x) © 


MATLAB’s gamma function says this is equal to (gamma(1/4)42)/(2* sqrt 
(2*pi)) =2.62205..., and quad agrees: quad(@(x)1./sqrt(sin(x)),0,pi/2) = 
2.62207.... 

Finally, in the definition (4.2.1) of the beta function make the change of variable 


a a 
l+y 
and so 
oe a 
_ l+y 1+y 
and 
dx 1 
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and so 


dy 
(l+y)” 


dx = 


oO y m-—1 1 n—-1 dy co y™! 
B(m, n) = | (4) (; ) 2 | m+n dy. 
o ity ty} (1t+y)° Jo (i+y) 


Then, setting n= | — m, we have 


co .,m-1 


dy = B(m,1 — m) = [(m)I(1 — m) 


Ley, 


(4.2.15) 


where the second equality follows by (4.2.5) because I(1) = 1. Later, in Chap. 8 
(in (8.7.9), we’ll show (using contour integration) that 


and so 


(4.2.16) eh aan) 


which is the famous reflection formula for the gamma function, discovered by Euler 
in 1771. 

The reflection formula will be of great use to us when we get to Chap. 9 (the 
Epilogue). There I'll show you Riemann’s crowning achievement, his derivation of 
the functional equation for the zeta function (the zeta function will be introduced in 
the next chapter) in which (4.2.16) will play a central role. There is one additional 
result we’ll need there, as well, one that we can derive right now with the aid of the 
beta function. We start with (4.2.5), 


_T(m)F(n)  (m— 1)\(n— 1)! 
Bi) T(m +n) (m+n-—1)! ’ 


from which it follows that 


m!n! 
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So, writing m=n=z, we have 


zz! 


a ea PG 


From the definition of the beta function in (4.2.1), 


1 
B(iz+1,z+1)= | x’(1 — x)*dx 
0 


and so 


zz! : 
———_—— = 7(1 — x)*dx. 
(z+)! ex xe 


Next, make the change of variable x = is (and so l—x= 1) to get 


ziz! 1 f1+s\7f1-s\71 sai ai2 
moa) (2) ee 
: =] —l 


or, since the integrand is even, 


z\z! oo is yz 
. 0 


Make a second change of variable now, to u= s* and (so ds = aa) to arrive at 


zz! : du : 1 
———_—=2-*] (1- | 1 —u)*u? du. 
eg oe 


The last integral is, from (4.2.1), 


a(5.2+ 1) : nes 1) (Hu! 


and so, recalling from (4.2.11) that (—3)! = /n, we have 


te a zl /t 
(2z+ 1)! (z+3)!. 
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Cancelling a z! on each side, and then cross-multiplying, gives us 


(4.2.17) 2\(z + 5)! = 2722-1 /q(2z + 1)! 
and since 

(s+3)!= (4a) -a)!= Fe) 9) 
and also 


(2z +1)! = (2z +1) (2z)!, 


then we can alternatively write 


(4.2.18) z! (z _ *)! = 2-22 «/n (22)! 


(4.2.17) and (4.2.18) are variations on what mathematicians commonly call the 
Legendre duplication formula. We'll use (4.2.18), in particular, in Chap. 9. 


4.3 Double Integration Reversal 


In Chap. 3 (Sect. 3.4) I discussed how reversing the order of integration in a double 
integral can be a useful technique to have tucked away in your bag of tricks. In this 
section I'll show you some more examples of that trick in which the gamma 
function will appear. Our starting point is the double integral 


| | sin (bx)y?'e*Ydx dy. 
0 Jo 


If we argue that the value of this integral is independent of the order of 
integration, then we can write 


(4.3.1) [- sin cox){ | yrteway dx = li etl sin (oxjerax bay, 


0 0 


Concentrate your attention for now on the right-hand-side of (4.3.1). We have, 
for the inner x-integral, 


4.3, Double Integration Reversal 131 


- b 
| sin (bx)e “Ydx = =—_,, 
0 be + y? 


a result you can get either by integrating-by-parts, or find worked-out using yet 
another trick that ll show you in Chap. 7, in the result (7.1.2). For now, however, 
you can just accept it. Then, the right-hand-side of (4.3.1) is calculated as 


oo b oo p-1 1° pl 
| ales ay =| dy = | v dy 
0 b+y? 0 b(1+ ) bJo 14+) 


Now, make the change of variable 


and so dy =b dt, which means the right-hand-side of (4.3.1) is 


Po! 


1 i (tb)?! 


7 | dt 
o I+t 


b 0 14+ : 


As [ll show you in Chap. 8, when we get to contour integration, we’ll find in 
(8.7.8) that 


oo xm z 
I 4x0" = Sin{(m4 yay 


So, if we let n= 2 and m=p-— | we have 


co 4pol x 
| z= A _ : 
o I+t sin {Eh 
Thus, the right-hand-side of (4.3.1) is 
bln 
2 sin {E} 
Next, shift your attention to the left-hand-side of (4.3.1). For the inner, 


y-integral, make the change of variable u= xy (where, of course, at this point we 
treat x as a constant). Then, du= x dy and so 


o0  mpyp-1_ du 1 [® 
| yP le dy = | () gee | uP-le" du. 
0 o \xX X XP Jo 
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The last integral is just the definition of ['(p) in (4.1.1), and so 


- 1 
P-le“*¥dy = —I(p). 
i ype “dy = —T(p) 


Thus, we immediately see that the left-hand-side of (4.3.1) is 


re). ants) dx. 


0 xP 


Equating our two results for each side of (4.3.1), we have (for 0 < p< 2), 


(ie sin(bx) — Pen 


(4.3.2) 0 xP a ar(p)sin{=} , 


This result reproduces Dirichlet’s integral if b=1 and p=1 (that’s good, of 
course!), but the real value of (4.3.2) comes from its use in doing an integral that, 
until now, would have stopped us cold: 


OO Ls q 
| sin (x%) 4 9 
0 x4 


For example, if q=3, what is 


OO gt 3 
| au ee 
0 Xx 


Note, carefully, that this is not 


eo 


which we’ll do later in Chap. 7, in (7.6.2). 
We start with the obvious step of changing variable to u= x‘. Then 


du xt qu 
as q-1 _ = 
a 1 "ala 
and so 
1/q 
dx = a du. 


qu 


4.3, Double Integration Reversal 133 


Thus, 


[ sin (x‘) den [ sin (u) (= iu) 1 [ sin (u) ss 


0 x4 0 u qu qig oa 


The last integral is of the form (4.3.2), with b= 1 and p = 2 — z and so 


) —— 


0 xd 2qr' (2 — J sin { (2 -H3h. 


i sin (x4) | x 


we have 


(4.3.3) 


| © sin(x?) 1 
x4 Ty aes: fae 
0 2qr (2 — ,) sin (z) : 


The result in (4.3.3) is formally an answer to our question, but we can simplify it 
a bit. The following is a summary of the properties of the gamma function where, 
because of the functional equation (4.1.2), z is now any real number and not just a 
positive integer. 
(a) P@=@—-)}; 
(b) [(@+1)=z!; 
(c) (z—1)!= a (alternatively, z! =z(z— 1)!; 
(d) T(z) (1 — z) = 


q 
sin (1z)* 


1 1 
From (b) we can write (2 = ~) = (1 = ~) ! and then, from (c), 
q. q q 
So, (4.3.3) becomes 


f sin (x4) | 1 
x 


q 1 1 
° : 2a(1 ) ( ) sin fz} 
q q s 
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or, 


(4.3.4) 


i ae a ao = (z—1)!(—z)! AES ica) ans 
and so 
Writin dope this becomes 
g q , 
(4.3.5) ( =) => , = 
— }! sin {[ — 
(3)! (;) 


Substituting (4.3.5) into (4.3.4), we get 


ae (9 


xX = I 


Dae oray ental 29) Gd 
q 


or, 


(4.3.6) [- sin) dx = (1) (= :) cos (=). 


From (c), which says z! = z(z — 1)!, we can write 


a ee eS 


L 
q 
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where the last equality follows from (a). Using this in (4.3.6), we at last have our 
answer: 


(4.3.7) er 


ee sin(x9) Aw | 
ae 


~ sin?) 4 FD 95 (8) PU) (v3) _ V5,(1 
| (= (a) 3") 


; «<2 a8) 4°43 


and MATLAB agrees:  sgrt(3)*gamma(1/3)/4 = 1.16001... and quad(@(x) 
sin(x.43)./x.43,0,10000) = 1.15928.... 
The trick of double integration reversal is so useful, let’s use it again to evaluate 


i 


dx, 
0 xP 


which is an obvious variation on (4.3.2). We start with 


| | cos (bx) y?'e*¥dx dy 
0 Jo 


and then, as before, assume that the value of the double integral is independent of 
the order of integration. That is, 


(4.3.8) \ cos (wx){ [ yrtesay x= ie min cos (oxjerax} dy. 


0 0 0 


Concentrate your attention for now on the right-hand side of (4.3.8). We have, 
for the inner, x-integral (from integration-by-parts) 


i = y 
cos (bx)e “dx = ~~. 
j on be + y? 


Thus, the right-hand side of (4.3.8) is 


a= ae ea Lf. 
les > ay = | x dy = ;| dy. 
0 bo +y 0 b(1+%) b’Jo 14% 


Now, make the change-of-variable 
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and so dy = b dt, which means that the right-hand side of (4.3.8) is 


ne) Pp ne) 
1 | (tb) ia= | tP 


= dt 
b? Jo 14+? 9 1+ 


Again, as before, we next use a result to be established later as (8.7.8): 


co xm nt 
dx = a ‘ 
1+x sin {(m + 1) #} 
So, if we let n= 2 and m=p, we have 


oo tP x x 
| dt = 2 = oes 
9 1+? ai {esuel cos { 


Thus, the right-hand side of (4.3.8) is 
bln 


2cos {Erh : 


Next, shift your attention to the left-hand side of (4.3.8). For the inner, y-integral, 
you'll recall that we’ve already worked it out to be 


a 1 
P-le-Ydy = —I(p). 
| ye “dy = —T(p) 


So, the left-hand side of (4.3.8) is 


re). — d 


X. 


Equating our two results for each side of (4.3.8), we have 


is cos(bx) — bea 


Oke pew, 


(4.3.9) 0 xP si 2r(p)cos{2=}’ 
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There is still a Jot more we can do with these results. For example, if we write 
(4.3.2) with u rather than x as the dummy variable of integration, then 


9 uP a 21 (p) sin {3} ’ 


[ sin (bu) bean 


and if we then let p = 1 — 7 this becomes 


o ult cal (1-1)x 
ar(i-} sin { . \ 


i sin (bu) bt x 


or, 


Now, let u= x* and so 


oe oe xk! 
dx 
and so 
k 
du =k~ =k“ dx. 
x uk 
Thus, 
co in (b © sin (bx* ee 
| Rica laem =| gs = K| sin (bx) dx 
0 u 0 u uk 0 
and so 
| sin (bx*) dx = : us 
0 2kb‘T(1 —}) sin {g-£ , 


From the reflection formula (4.2.16) for the gamma function 


(ni) a 
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and so 
1 T 
rg) “ran 
or, 
[oe] aly : x L x - 
| i (bx*) ies at _ gh a ar (%) sala {ad “ eal 
0 2kb*k sin {8 ae Akb*k sin {8 — £}. 
Thus, as 
1 1) 
sin -x} = sin {5} cos { } cos {5} sin {=} cos {=}, 
we atrive at 
FI (TE 
oO wy ay — Fesint aed 
(4.3.10) Jo sin(bx") dx = a be Ok > i 


For example, if b= 1 and k= 3 then (4.3.10) says that 


es 1(3) sin {3} _ 3G) _ 1 (3) 
3)dx = = =-I'( =) = 0.446489... 
|, sin (x°) X 3 3 6 3 


If, in (4.3.9), we use u rather than x as the dummy variable of integration, then 


du = 


[° cos (bu) bPol x 
4 uP 21'(p) cos {eh : 


As before, let p = 1 — t (and then u=x*) and so (skipping a few steps) 


a brEx 
k| cos (bx*)dx = 
0 ( ) ar(1 — ;) cos i vat 
and thus 
| cos (bx*) dx = ; . 
0 2kb‘T'(1 — 1) cos {3-4}. 
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Since 


we have 


1 ams 
f° cos(bx*) dx = Mpeost zi) 


Z 
kbk 


(4.3.11) 


If b= 1 and k=3 then (4.3.11) says that 


3 


i cos (x3)dx = nioleeite ee) r(5) = 0.77334... 


P 3 a 4 


Notice that { 3° cos(x*)dx £ les sin(x?)dx. 


iales ae See 
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Finally, here’s one more example of the reversal of double integration order 


trick. Recall our earlier starting point in deriving (4.3.9): 


e y 
cos (bx)e “dx = =~... 
j oP) b+ y? 


If we integrate both sides with respect to y from 0 to c > 0 we have 


c 
| { 
or, reversing the order of integration on the left, 


oe) c 7 c y 
4.3.12 | cos (bx {| e Yd bax =| —_——- dy. 
( ) F (bx) : y pee 


Clearly, 


[oe] 2 c y 
cos (bx)e *Ydx pd -| | 
I ON } ob +y? 
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Now, on the right-hand side of (4.3.12) let u= b+ at and so 


du = 
dy = 
or, 
d 
dy = =, 
2y 
Thus, 


i y a=[ >> du =3 [= bint 
0 b+ y?2 yp  u\2y 2 Jy u 2 7 


So, (4.3.12) becomes 


b2 +c? 
b2 


co1-—e &% 


1 
—— cos(bx)dx = sIn( 


0 


(4.3.13) 


This is obviously correct for c=0 (giving zero on both sides of (4.3.13)). If 
b=c=1, then (4.3.13) says that 


0 1 et 1 
| © cos (x)dx = = In(2) = 0.3465... 
0 x 2 


and MATLAB ‘agrees’ as quad(@(x)(/-exp(-x)).*cos(x)./x,0,500) = 0.3456... . 
If we write (4.3.13) twice, first with c=r and b=p, we have 


oye 1 2 2 
| © cos (px)ax = Fin(2 ate ; 
0 x 2 Pp 


and then again with c=s and b=q, we have 


oo 4 — esx 1 2 2 
| © cos (qx)dx = =In (*S*) : 
0 Xx 2 


Thus, 


oo 1 — eX ~*~ {ex 1 q? + 52 1 p- + r 
dx — dx = x1 ] 
| ~ o88 (qx)dx | = 08 (px)dx 5 a( 5 in 


0 0 
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or, 


| cos (qx) — cos (px) ae | e~™ cos (px) — e~ ** cos (qx) re 
0 


xX 0 x 
gts 
q? 2,2 ~ 2,2 2 

=<.lIn 5 x/= In a =o =-.lIn es In E 
p +r ptr q 2 po +r 2 q 

2 
p 
1 q? +s? p 
5 pie + In 


But since the first integral on the left in the last equation is In (2) by (3.4.6), we have 


the result 


i. e” ™cos(px) — e7 S*cos(qx) 
x 
0 


xX 


(4.3.14) 


For example, if r=q=0 and p=s= 1, then (4.3.14) reduces to 


[- cos (x) —e* 


0 xX 


dx = 0, 


a result which we’ll derive again in Chap. 8, in (8.6.4), in an entirely different way 
using contour integration. 


4.4 The Gamma Function Meets Physics 


Back in Chap. | (Sect. 1.8) I showed you some examples of integrals occurring in 
physical problems and, as we are now approximately half-way through the book, I 
think the time is right for another such illustration. In the following analysis you’ ll 
see how gamma functions appear in a problem involving the motion of a point mass 
under the influence of an inverse power force field (not necessarily restricted to the 
inverse-square law of gravity). Specifically, imagine a point mass m held at rest at 


y =a, ina force field of magnitude roa directed straight down the y-axis towards the 


origin, where k and p are both positive constants. (An inverse-square gravitational 
force field is the special case of p= 1, but our analysis will hold for any p> 0. 
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For the case of p= 0, see Challenge Problem 7.) Our problem is simple to state: The 
mass is allowed to move at time t=O and so, of course, it begins accelerating 
down the y-axis towards the origin. At what time t= T does the mass arrive at the 
origin? 

From Mr. Newton we have the observation “force equals mass times accelera- 
tion’ or, in math,! 


d’y 


F=m—>,. 
dt? 


Now, if we denote the speed of the mass by v then 


dy 
v=— 
dt 
and so 
dv d’y 
dt dt? 


which says (invoking the amazingly useful chain-rule from calculus) that 


dv dv\ /dy dv 
F=m—=m =mv—. 
dt dy/ \ dt dy 


So, 
(4.4.1) 


where we use the minus sign because the force field is operating in the negative 
direction, down the y-axis towards the origin. This differential equation is easily 
integrated, as the variables are separable: 


' Newton didn’t actually say this (what is known as the second law of motion), but rather the much 
more profound ‘force is the rate of change of momentum.’ If the mass doesn’t change with time 
(as is the case in our problem here) then the above is okay, but if you want to study rocket physics 
(the mass of a rocket decreases as it burns fuel and ejects the combustion products) then you have 
to use what Newton really said. 
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Now, integrating indefinitely, 
1 kf{d k k ~P k 
v2 = | ue = [y-ray = (- «) (=) +C= +C 
2 m J yPt m m/ \—p mpy?P 


»_ 2k 
mpy? 


or, 


Vv +2C 


where C is the arbitrary constant of integration. Using the initial condition v=0 
when y =a, we see that 


_ k 
~ mpaP’ 
So, 
a 2k 2k 2k {1 1 
v= = ‘ 
mpy? mpaP mp \yP_ aP 
Thus, 


dy\? 2k /1 1 
dt/  mp\y? aP 


or, solving” for the differential dt, 


d 
eae mp mite ot _,. /mp dy _ ,. /mp ap/? dy 
V 2k \a/se— arf 2k Jae * M0)’ re 
y 


aP yP 


Integrating t from 0 to T on the left (which means we integrate y from a to 0 on 
the right), 


? Notice that sign of dt is written with the ambiguous +. I’m doing that because it’s not clear at this 
point (at least it isn’t to me!) which of the two possibilities coming from the square-root operation 
is the one to use. Physically, though, we know T > 0, and we’ll eventually use that condition to 
make our decision. 
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Changing variable to u = ~ (and so dy =a du), this becomes 


0 0 p/2 
T= ta [FP | 4 du = tal)! | ao ay 
1 1 


aa ll 2k 1 Vl — uP 


or, using the minus sign to make T > 0 (see the last footnote), 


peat, BP i a 


———— du. 
2k o Vl—uP 
Now, let 
x=uP 
and so 
dx 7 pu? px 
i ar 
XP 
or, 
ny 
P 
du = cid dx 
px 
Thus, 


Oo mp Py yt 

Pysi 

=a)" aI x. (1—x) dx. 
2kpJo 


This last integral has the form of the beta function integral in (4.2.1), with 


and 
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That is, 
m=-+-7 
p 
and 
1 
n=. 

2 

So, 


we at last have our answer: 


T(istl 
(4.4.2) T< 0 am , p>o. 


A final observation: the mass arrives at the origin with infinite speed because the 
force field becomes arbitrarily large as the mass approaches y = 0. That means there 
is some point on the positive y-axis where the speed of the mass exceeds that of 
light which, it has been known since Einstein’s special theory of relativity, is 
impossible. This is a nice freshman math/physics textbook analysis in classical 
physics, but it is not relativistically correct. 
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(C4.1): Find 
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and, in particular, use your general result to show that 


1(9) = | (1 — vx) de = 5. 


(C4.2): Prove that 


! n! 
[x In"(x)dx = (—1) (mys 


We’ll use this result later, in Chap. 6, to do some really impressive, historically 
important integrals. 


(C4.3): Show that the integral of x?y? over the triangular region defined by the x and 
y axes, and the line x+y=1, is ( alb! yp where a and b are both non-negative 


atb+2 
constants. 
(C4.4): Use (4.3.2) to evaluate | CLS and (4.3.9) to evaluate | CO) 
0 x 0 x 


These are famous integrals, which we’ll later re-derive in an entirely different 
way in (7.5.2). Also, use (4.3.10) and (4.3.11) to evaluate ie sin(x*)dx and 
les cos(x”)dx. These are also famous integrals, and we’ll re-derive them later in 
an entirely different way in (7.2.1) and (7.2.2). (Notice that while we showed 
J 3° cos(x*)dx A f % sin(x*)dx, [ &° cos(x*)dx does equal f % sin(x”)dx.) 


(C4.5): Use the double-integration reversal trick we used to derive (4.3.13) to 


evaluate (for b>0, c>0) | ans) 
0 x 


used to begin the derivation of (4.3.2), | sin (bx)e “dx = 
0 


e “dx. Hint: start with the integral we 


and then inte- 


b 
b?+y?’ 
grate both sides with respect to y from c to infinity. Notice that the result is a 
generalization of Dirichlet’s integral in (3.2.1), to which it reduces as we let c— 0. 


(C4.6): Evaluate the integral | G+ in terms of gamma functions, where 
0 x 
a, b, and c are constants such that a>—1, b>0, and be >a+1, and use your 


oe) X/K 


dx. Hint: make the change-of-variable 


formula to calculate the value of | Fi 


o (14+x) 
y= x” and then recall the zero-to-infinity integral form of the beta function that we 
oe) m—1 
: : y 
derived just before (4.2.15): B(m,n) = | —— a dy. 
o (I+y)™* 


(C4.7): Notice that T in (4.4.2) is undefined for the p = 0 case (the case of an inverse 
first power force field). See if you can find T for the p=0 case. Hint: Set p=0 in 
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(4.4.1) and then integrate. You’ll find (3.1.8) to be quite useful in evaluating the 
integral you'll encounter. 


(C4.8): How does the gamma function behave at the negative integers? Hint: use 
the reflection formula in (4.2.16). 

® sin (x”) 1 
C4.9): Show that dx = 
aa |, ve Saran ® 


. To ‘check’ these results, the evaluations of the expressions on the 


and that | 
0 


4r(3) cos (32) 
right-hand-sides of the equality signs are pi/(4*gamma(3/4)*sin(3*pi/8)) = 
0.69373... and pi/(4* gamma(3/4)*cos(3*pi/8)) = 1.67481..., respectively, while 
the integrals themselves evaluate as (using Symbolic Toolbox, after defining x as a 
symbolic variable)) double(int(sin(x42)/sqrt(x),0,inf)) = 0.69373... and double(int 
(cos(x42)/sqrt(x),0,inf)) = 1.67481... . 

Hint: In (4.3.2) and in (4.3.9) set b= 1 and make the substitution x = y. 


Chapter 5 
Using Power Series to Evaluate Integrals 


5.1 Catalan’s Constant 


To start this chapter, here’s a very simple illustration of the power series technique 
for the calculation of integrals, in this case giving us what is called Catalan’s 
constant (mentioned in the Preface) and written as G=0.9159655 ... . The power 
series expansion of tan” '(x), for Ix| < 1, is our starting point, and it can be found as 
follows. The key idea is to write 


* dy -1 x -1 
|, ice (y)|o = tan '(x). 


Then, by long division of the integrand, we have 


x 


tan (x) = | (l-y’+y*—y°+y*—---)dy 


0 

Ce ee, ce es | 
= A ai RT aaa Nt eae WF 
ae (eal Wee ae pe gg oe 

and so 
tan ~!(x) xo x8 
=1 
x ag ce 


and therefore, integrating term-by-term, we have 
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We check our calculation with guad(@(x)atan(x)./x,0,1) =0.9159656.... 
We can use power series to show that an entirely different integral is also equal 
to G. Specifically, let’s take a look at the following integral (mentioned in the 


Preface): 


[° In(x) 
5 dx. 
1 x°+1 


We can write the ‘bottom-half’ of the integrand as 


1 1 
e+1 x2(14+5)=5[1 t++4 St-:)] 


where the endless factor in the brackets follows from long division. Thus, 


i In(x) ax=| fin lots) In) ban 


1 +1 1 x2 x4 xo 


We see that all the integrals on the right are of the general form 


°° In(x) . 
xk dx, k an even integer > 2, 
1 


an integral that is easily done by parts. Letting u = In(x)—and so du = 1 which says 
de and letting dv = 4.dx and so v = an =-4 (tz) we then have 


[a= In(x) (1 P+ 1 [ 1\d 1 ie 
Lk Tx) fh k= 1s, (xe!) x  k-14J, xk 


i, =< 


. ial |" = 1 = 1 
—k=-1\-k4+ if [k= 1)?xe1 fl k= 1)" 


du = 
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So, 
[° Pel a= 1 fH. A ee re 
¢ eel @=i1f Gi" (6=1) “ff FS 
or, 
© In(x) 
5.1.2 ——— dx =G. 


And so it is, as quad(@(x)log(x)./(x.42+1),1,1e6) = 0.91595196... 
We can combine this result with an earlier one to now calculate 


[° In(x + 1) 


dx, 
0 x2+1 : 


which we can write as 


dx. 


I In(x +1) | [° In(x + 1) 
x4 
9 xt+1 1, til 


We’ve already done the first integral on the right, in our result (2.2.4) that found 
it equal to $1n(2), and so we have 


i BED iy oy: [oa =Zin(2) + oe, 


0 x74+1 8 1 x2 +] 


1 
= = In(2) + i. Be 4 [- i) : ‘ d 


1 e+) 1 x+1 


The first integral on the right is (5.1.2) and so 


re In(1 + 1) 


oan | 1 
| nies 2) . dx, 
1 x+1 


T 
dx = —In(2)+G 
«Head X g in(2) + +| 
and in the remaining integral on right make the change of variable u = 1 (and so 


du = —-4 or, dx = —x2du = — a). Thus, 
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, “+1 Io w+ 


ee eo 


1 


but this is just (2.2.4) again! So, 


SIn(fx+1) 1 
or, finally, 
“In(x + 1 
(5.1.3) i ae 
eo kein E 


This is equal to 1.46036 ... while quad(@(@)log(x+1)./(x.42+1),0,le6) = 
1.46034839.... 

Returning to the main theme of this chapter, as our last example of the use of 
power series in this section, consider now the integral 


=e 6 sin (6) 
9 a+b cos2(6) 


where a >b>0. Then, expanding the integrand as a power series, 


I= 2 osinoy{ — (2) cos 7(@) + (2) cost) — (2) cost) oan 


at ff sinoyan ” (?) lf @ sin (8) cos2(0)d® + (?) | sin (8) cos 4(8)d0 — -- . 


a | Jo 0 


Looking at the general form of the integrals on the right, we see that for n=0, 
1, 2,... we have 


| Qsin(0) cos *"(0)d8. 
0 


This is easily integrated by parts to give (use u=0 and dv = sin(0)cos*"(0)d0) 


1 (a) 2n+1 Q x 
| 9 sin (8) cos 2"(8)d0 = Ss} 
0 2n + 1 0 
1 T 
| cos 7"*!(9)d@ = = 
2n+ 1 0 2n + 1 
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because it is clear from symmetry (notice that 2n+ 1 is odd for all n) that 
| cos "*!(Q)d0 = 0. 
0 


So, 


EL 5Q8Q 40 
nyalvb 1/bvb\ 1/b’Vvb\ 1/b’vb 
Rafts (Ra) +3(ea) ale) 


-5[()"-2@) +30) 10) + 


or, if you recall the power series expansion for tan” '(x) from the start of this section 


re 


1/2 
and set x = (2) / , we see that 


(o 6 sin(@) 


0 a+bcos?(0) 


(5.1.4) 


For example, if a= 1 and b=3 then 


* — xsin (x) i. 4 _ 
| bot (v3) = 1.899406... 


while quad(@(x)x.*sin(x)./(Z + 3*cos(x).42)),0,pi) = 1.8994058. . .. 


5.2 Power Series for the Log Function 


Using essentially the same approach that we just used to study Catalan’s constant, 
we can evaluate 


1 

] 

| ) +) dx. 
0 xX 
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We first get a power series expansion for In(x + 1), for Ix| < 1, by writing 


Xx 


x q 7 
| P= in +9) =m +x) = | (l-y+y?-y?+--)dy 


olt+y 0 
2 (3 v4 
ae eee ee ee Aer 
oa ae lp 
or, 

2 (3 y4 
x* x x 

In(1 4 = teey 1. 

n(l+x)=x zh a+ Ix] < 


(You may recall that I previously cited this series (without derivation) in a footnote 


in Chap. 2.) 
Thus, 


0 xX 0 2 3 4 
x2 xd x4 & 1 1 1 1 1 
—~lx - = Se at 
2 3? 0 2 3? 


In 1734 Euler showed that! 


o J ,,1,1 1 _@r 
Lap tt at ete 


which is the sum of the reciprocals squared of a// the positive integers. If we write 
just the sum of the reciprocals squared of all the even positive integers we have 


co 1 1 co ol nr 
ae (2k)? - ae kK 24° 


'T mentioned this sum earlier, in the Introduction (Sect. 1.3). Later in this book, in Chap. 7, Pll 
show you a beautiful way—using integrals, of course!—to derive this famous and very important 
result. What I’Il show you then is not the way Euler did it, but it has the distinct virtue of being 
perfectly correct while Euler’s original approach (while that of a genius—for details, see my book 
An Imaginary Tale, Princeton 2010, pp. 148-9) is open to some serious mathematical concerns. 
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So, the sum of the reciprocals squared of all the odd positive integers must be 


If you look at the result we got for our integral, you’ll see it is the sum of the 
reciprocals squared of all the odd integers minus the sum of the reciprocals squared 


of all the even integers (that is, x — a — ©) and so 


(5.2.1) 


This is equal to 0.822467..., and quad agrees: quad(@(x)log(1+x)./x,0,1) = 
0.822467... . It is a trivial modification to show (I’ll let you do this!—see also 
Challenge Problem 7) that 


(5.2.2) 


This is — 1.644934..., and quad again agrees: quad(@(x)log(/+x)./x,0,1) = 
—1.64494.... 
Okay, what can be done with this integral: 


You, of course, suspect that the answer is: use power series! To start, write 


[e{ (S) fo J pein + In(1 — x) }dx. 


Earlier we wrote out the power series expansion for In(1 +x), and so we can 
immediately get the expansion for In(1 — x) by simply replacing x with —x. Our 
integral becomes 


w 
o a 
Pal _ 
——_ 
a 
Pe 
w] 
+ 
Ww Ww 
BM 
a8 
NE 
GO NS 
Pal 
w|% 
wo] 
NaN 
NE 
— 
a. 
=] 


= i. pee 45 ea ax =a) ie ea ae. dx 
hae 3 5 7 3 : 
4 
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or, finally, 


el 14+x)\2 
Jo inf 


(5.2.3) 


This is equal to 4.934802 ..., and quad agrees: quad(@(x)log(((/+x)./U-x)).42)./ 


x,0,1) = 4.934815.... 
We can mix trig and log functions using the power series idea to evaluate an 


integral as nasty-looking as 


m/2 
| cot (x)In{ sec (x) }dx. 


dt 
Let t = cos (x). Then — = — sin (x) or, dx = —— : 
dx sin (x) 


[ cot (x)In{ sec (x) }dx = i_ a inf aw hax 
_ -[ SOs it cod oo) au \ 


, sin (x) ~ sin (x) 


_ -| cos (x) In{ cos (x)} dt = -[ —aln(tat. 


9 sin?(x) 
Over the entire interval of integration we can write 


t 
qa ee ee sy 


which is easily verified by cross-multiplying. That is, 


_ 3 5 7 aA ee Of etl 
he 


Thus, our integral is 


-[ boar a in(e)at 
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r , : é 2 
or, assuming that we can reverse the order of integration and summation,” we have 


ba cot (x)In{ sec (x) }dx = SS , {{ etinat}, 


0 0 


We can do this last integral by parts: let u=1In(t) and dv =t?"*! dt. Thus du a 7 


pent2 


or, du = +dtandv = Inia 8, 
1 2n+2 1 42n42 1 
t 1 t 1 1 
| r*In(t)dt = In(t) | dt = | rr dt 
0 2n+2 0 9 2n+2 t 2n+2 0 
1 p2n+2 1 1 
~ n+2)2n+2 = (Qn42)" 


So, 
[ cot (x)In{ sec (x) }dx = ~~ oe ¥.. I 
0 — 4n=0 (Qn + a, ~ 4 4n=0 (n+ 1 

alye Lie 
~ 44~k=14? ~ 4\ 6 

or, 

Tt/2 12 
(5.2.4) J," cot(x) Infsec(x)}dx == . 


This is 0.4112335 ..., and quad agrees: quad(@(x)cot(x).*log(sec(x)),0,pi/2) = 
0. 411230... . 

For one more example of a power series integration involving log functions, let’s 
see what we can do with 


I In(1 + x)In(1 — x)dx. 
0 


If you look at this for just a bit then you should be able to convince yourself that, 
by symmetry of the integrand around x = 0, we can write 


? This reversal is an example of a step where a mathematician would feel obligated to first show 
uniform convergence before continuing. I, on the other hand, with a complete lack of shame, will 
just plow ahead and do the reversal and then, once I have the ‘answer,’ will ask quad what it 
‘thinks.’ 
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rl if 
| In(1 + x)In(1 — x)dx = aI In(1 + x)In(1 — x)dx. 


(Or, if you prefer, make the change of variable u = — x and observe that the integral 
becomes f° , In(1 —u)In(1 +u)du. The integrand is unchanged. So, [= {°, and 
thus f°, + {j= f1,=2J)§. as claimed.) Now, make the change of variable y 
= <1 (and so dx = 2dy). Since x = 2y — | then 1+x=2y and 1 —x=1-—(Qy-1) 
= 2-2y, all of which says 


1 


| In(1 + x)In(1 — x)dx = 5 In(2y)In(2 — 2y)2dy = | In(2y)In{2(1 — y)}dy 
0 0 0 


2 | [in(2) + In(y)][ln(2) + In(1 — y)]dy 


= |, [¢an(ayy? + n(2y in(y) + im(1 — y)} + In(y)in(t — y) ay 


= {In(2)}2 + in2)4 | 


1 1 


In(y)dy + | In(1 — y)ay} + | In(y)In(1 — y)dy. 


0 0 


Since 


i In(y)dy = if In(1 — y)dy, 


either ‘by inspection’ or by making the change of variable u= | — y in one of the 
integrals, we have (changing the dummy variable of integration back to x) 


1 


i In(1 + x)In(1 — x)dx = {In(2)}* + 2m) In(x)dx + | In(x)In(1 — x)dx. 
0 0 0 


Since 


I In(x)dx = {xIn(x) — x}, =-l, 


we have 
1 


i In(1 + x)In(1 — x)dx = {In(2)}* — 2In(2) + | In(x)In(1 — x)dx 
0 0 


and so all we have left to do is the integral on the right. To do 
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1 
| In(x)In(1 — x)dx 
0 
we'll use the power series expansion of In(1 — x). As shown earlier, 


x2 x x4 


In(1 = [x] <1, 
n(1 — x) X-7-37-| x| 
and so we have 
: we 10> 
In(x)In(1 — x)dx = — — | x“In(x)dx. 
5 k=1k 


0 


If you look back at our analysis that resulted in (5.2.4), you’ll see that we’ve 
already done the integral on the right. There we showed that 


I 
1 
| e+ n(t)dt = ———_, 
0 (2n + 2) 


and so we immediately have (replacing 2n + | with k) the result 


1 

1 

| x‘In(x)dx =— as 
0 (k +1) 


Thus, 


1 00 1 foe) 1 1 
| In(x)In(1 — x)dx = ae k(k +1) = ye k(k+1) (k+1) 


“Da [U) (Ga) 


So, finally, 


ie In(1 + x) In(1 — x) dx = {In(2)}* — 2In(2) + 2 - us . 


(5.2.5) 
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This is equal to —0.550775..., and in agreement is guad(@(x)log(/+x).*log(U- 
x),0,1) = — 0.55078... . 
T’ll end this section with the calculation of 


1 2 

I 

f WaOF 
0 1 + x? 

an integral that will find an important use later in the book. The trick here is to 

make the change of variable x=e *, which is equivalent to y= —In(x). Thus, 

dy = —+dx and so dx = —x dy=—e’ “dy. So, 


' {In(x) }? ae % 
=| ——{-e"g} =] y¥ Wy gL ery 
I 14x? oo | . r=] x0 re ey +---JeFdy 


=| y(er ey teoy —e V4 -++)dy. 
JO 


From standard integration tables (or integration by parts) 


" ay 2y 2\j~ 2 
| y’e™ dy me a = | = >0 
0 a a az/io a3 


because a < 0 in every term in our above infinite series integrand. Thus, 


ees 


0 14+ x? 


1 1 1 1 
dx =2 3 pr 
but it is known’ that the alternating series is equal to a So, 


(5.2.6) 


O 14x? 16° 


ie {In(x)}? d 


This value is 1.9378922... and, using quad to check: quad(@(x)log(x).42./U+x. 
A2),0,1) = 1.9379. ... 
There are two additional comments we can make about this integral. First, 


0 1+ x? 


9 1+x? 8 


|" fins) ay af {ing)} 4 -® 


3 See my Dr. Euler’s Fabulous Formula, Princeton 2011, p. 149 for the derivation of this result 
using Fourier series. 
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I'll let you fill-in the details (simply notice that [5° = i +f?° and then make the 
change of variable y = tin the ie integral). And second, look at what we get when 
we consider the seemingly unrelated integral 


/2 
| [In{ tan (0) }]?d0 


if we make the change of variable x = tan(®). Because 


dx cos*(@) + sin?(0) 


_ = 2 
dO cos 2(8) ey 
we have 
1 1 
os 1+ wo l+x 
and so 
- * {in(x)}? 
2 — 
| (In{ tan (8) }]"dd = | i+x2 dx 
Thus, 
(5.2.7) J, [In{tan(@)}]? d0 = 


This is 3.8757845..., and quad confirms it: quad(@(x)log(tan(x)).42,0,pi/2) = 
3.8758..... We'll use this result in Chap. 7, when we finally calculate Euler’s sum 
of the reciprocal integers squared. 


5.3. Zeta Function Integrals 


In the previous section I mentioned Euler’s discovery of 


o lL x 
Dae 


This is actually a special case of what is called the Riemann zeta function: 


(8) = Dap 
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where s is a complex number with a real part greater than | to insure that the sum 


converges." Euler’s sum is for s=2 but, in fact, his method for finding ¢(2)— 


xt 


= 907 
C(6) = = c(8) = iste and ¢(10) = ae In general, ¢(s) = 22°, where m 
and n are integers, if s is an even positive integer. Euler’s method fails for all 
positive odd integer values of s, however, and nobody has succeeded in the nearly 
300 years since Euler’s discovery of €(2) in finding a formula that gives C(s) for 
even a single odd value of s. 

Mathematicians can, of course, calculate the numerical value of C(s), for any s, 
as accurately as desired. For example, €(3) = 1.20205 ..., and the values of those 
dots are now known out to at Jeast a hundred billion (!) decimal places. But it is a 
formula that mathematicians want, and the discovery of one for €(3) would be an 
event of supernova-magnitude in the world of mathematics. 

Ironically, it is easy to write C(s), for any integer value of s, even or odd, as a 


xty@ 
1—xy’ 


spoken as zeta-two—works for all positive, even integer values of s; €(4) 


double integral. To see this, write the power series expansion of where a is (for 


now) a constant: 


x4y* 


Pog TEV tt Oxy)? + Oxy)? + Gy)" + Gy) +f Pl <1 


Then, using this as the integrand of a double integral, we have 


1 fl aya 1 
| | x"y ax dy =| = [tye + ayett 4 xy? yet + Jay te 
0 


o Jo 1 — xy 
0 
1 a+1 a+2 a+3 a+4 1 
=|x a a a ee | dx 
0 a+1 a+2 a+3 a+4 0 
i xa xatl xat2 xat3 
= ae f+++ »dx 
o}at+l at+2 a+3 a+4 
xatl xat2 xat3 xat4 1 
~ 20 aT z+ gre | 
(atl) (a+2)° (a+3)° (a+4) 0 
1 1 1 


“rly @t2° (ata) 


and so 


“For s = 1, (1) is just the harmonic series, which has been known for centuries before Euler’s day 
to diverge. 
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(5.3.1) 


Now, if we set a=0 then (5.3.1) obviously reduces to 


1 fl 1 2 
| | 1- Xy a os n2 C( yy 


but we can actually do much more with (5.3.1) than just €(2). Here’s how. Remem- 
bering Feynman’s favorite trick of differentiating under the integral sign, let’s 
differentiate (5.3.1) with respect to a (which started off as a constant but which 
we’ ll now treat as a parameter). Then, on the right-hand side we get 


oo 1 
—2 
ae (n +4 a)* 


On the left-hand side we first write 


d 1 fl aya 1 1] aln(xy) 

=| | xy ax dy = | | ual dx dy. 
xy 

Thus, 


l aln(xy) 
i i MONEE ae 5 
ojo L-xy — m1 (pn fa)? 


Now, differentiate again, and get 


1 pl n(x 2 galn(xy) a 
| | n/a dy = (-2)(-3)$> ies 


1 —xy 


Indeed, if we differentiate over and over you should be able to see the pattern: 


n(xy)}5> 2 ealn(xy) or) 
jj, oe dx dy = (—2)(—3)...(—{s We az 


1 — xy 


So, returning e* ™@Y) back to (xy)" we have, for s > 2, 
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ie {e (xy) {In(xy)}$~2 dx dy = (-1)%(s = 1)! ye 1 


1-—xy =1m+a)s ° 


(5.3.2) 


Or, for the particularly interesting case of a= 0, 


C(s) am cee ZT {In(xy)}§~2 dx dy 


i S937 


(s—1)! 


(5.3.3) 


For s=5, for example, it is easy to calculate €(5) directly from the 
sum-definition of the zeta function to get 1.0369277..., while the right-hand-side 
of — is aes with the following MATLAB Symbolic Toolbox code (factor 


” ) to be 1.0369277.. 


= —tis Gr 


syms x y 
factor = -1/24; 
int(int(log(x*y)43/(U1-x*y),x,0,1),y,0,1)*factor 


To end this section, I’1l now show you a beautiful result that connects the gamma 
function from Chap. 4 with the zeta function. You’ll recall from (4.1.1) that 


T(s) =| e*xs! dx. 
0 


So, starting with the integral 


| e xs! dx, k > 0, 
0 


make the change of variable u= kx which gives 


Oe eee se me sIdu 1f*  . I(s) 
kx s—1 u u,,s—l 
dx = (=) da=— 
| eo x x | e k 2 =a, e “u u KS 
Then, summing over both sides, we have 
co 7 —kx,s—1 = = _ 
Ss | ex! dx = i T(s)So a T(s)C(s). 


Next, assuming that we can interchange the order of summation and integration, 
we have 
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T(s)€(s) = - a ane e dx. 


The summation in the integrand is a geometric series, easily calculated to be 


oo 1 
ae ae 


and so we immediately have the amazing 


Sint 


x 


that was discovered in 1859 by non-other than Riemann, himself, the hero of this 
book. For s = 4, for example, (5.3.4) says that—trecalling Euler’s result€(4) = — 


4 


i oe ie T(4)¢(4) = (3!) (5) = « 


o «x - 1 


and you’ll recall both this integral and its value from the Preface (see note 6 there). 
This theoretical value is 6.493939... and MATLAB agrees, as quad(@(x)(x.‘3)./ 
(exp(x)-1),0,100) = 6.493939.... 
With a little preliminary work we can use the same approach to do an interesting 

variant of (5.3.4), namely 

love) s—l 

| = dx. 
0 ex + 1 


To set things up, define the two functions 


Bice 
us == eee 
1s 38 58 7 
and 
ae ee 

Vs 1S 28 38 4s | 

and so 
1 1 1 1/1 1 1 1 
C(s) a ae Us TF 5s tas t 3st = us + 556(s). 


Thus, 


166 5 Using Power Series to Evaluate Integrals 


(5.3.5) reac) [ : =| 


Also, 


So, using (5.3.5), 
v= 2691-3] - 66) =069]1- 3]. 
Thus, 
(5.3.6) Vets) (t—2|. 


But, noticing that 


we have 


00 (-1)" _ 1 gi-s 
(5.3.7) Sea eS 
Now we can do our integral! We start with 


| (<1) x de, 
0 


again make the change of variable u = kx, and then repeat what we did for (5.3.4). 
Everything will go through as before, except that you’ll get one sum that will yield 
to (5.3.7), and another that will be ¥ 9° ,(—1)*~ 'e~ * instead of 2° ,e7 “. That 
will still give a geometric series, one still easy to do, with a sum of 


The end-result is 
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f° ax = [1 — 2°] (ES), s> 1. 


0 eX41 


(5.3.8) 


For s=4, for example, this says 


Ik Bayes 1 —23)r(aye(a) = (2 m" _ 5.68219 
o etl A815 _ 
and MATLAB agrees, as quad(@(x)(x.‘3)./(exp(x)+/),0,100) = 5.68219... . 

By the way, notice that for s=1 (5.3.8) gives an indeterminate value for the 
integral; 


|" : dx = [1 —2!'"]F(1)¢(1) = (0)(1)(co) =? 


0 ex +] 


because C(1) is the divergent harmonic series. This, despite the fact that the integral 
clearly exists since the integrand is always finite and goes to zero very quickly as x 
goes to infinity. This indeterminacy is, of course, precisely why the restriction s > 1 
is there. So, what is the value of the integral for s = 1? We’ve already answered this, 
back in our result (2.1.4), where we showed that 


od 1 
| dx = Be), 
9 ex+1 a 


For s= 1 in (5.3.8) we set a= 1 in (2.1.4) and our integral is equal to In(2). 
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Since the 13th century it has been known that the harmonic series diverges. That is, 


k=l1k  n00 


The divergence is quite slow, growing only as the logarithm of n, and so it seems 
quite reasonable to suspect that the difference between H(n) and log(n)=In 
(n) might not diverge. In fact, this difference, in the limit, is famous in mathematics 
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as Euler’s constant (or simply as gamma, written as ye That is, y = limp... y(n) 
where 


y(n) = >", In(n). 


It is not, I think, at all obvious that this expression does approach a limit as 
n—oo but, using the area interpretation of the Riemann integral, it is easy to 
establish both that the limit exists and that it is somewhere in the interval 0 to 
1. Here’s how to do that. 


Since 
maielats + In(n) 
y(n 513 . n(n 
then 
(n+ 1) — y(n) = (ee 5 a In(n + 1) 
ne - 2°73 ae eS ae 
1 1 1 
1 1 n 
= + | l | = +] 
n+1 pe al n+ 1 n(— :) 


or, 


y(n+ 1) ~Y(n) = — in(1 a): 


Clearly, in(1 - Hy) < 0 as it is the logarithm of a number less than 1. But we 


can actually say much more than just that. 
Recalling the power series for In(1 +x) that we established at the beginning of 
Sect. 5.2, setting x = Ts gives us 


> A technically sophisticated yet quite readable treatment of ‘all about 7,’ at the level of this book, 
is Julian Havil’s Gamma, Princeton University Press 2003. The constant is also sometimes called 
the Euler-Mascheroni constant, to give some recognition to the Italian mathematician Lorenzo 
Mascheroni (1750-1800) who, in 1790, calculated y to 32 decimal places (but, alas, not without 
error). As I write, y has been machine-calculated to literally billions of decimal places, with the 
first few digits being 0.5772156649 .... . Unlike a or e which are known to be irrational 
(transcendental, in fact), the rationality (or not) of y is unknown. There isn’t a mathematician on 
the planet who doesn’t believe y is irrational, but there is no known proof of that belief. 
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1 1 1 1 
Inj 1 = 5) 3 
nal n+l 2(n+1)° 3(n+1)° 
This says that in(1 — ata) is more negative than — 1, and so 
y(n+1)— y(n) < 0. 
That is, y(n) steadily decreases as n increases and, in fact, since y(1)=1—In 


(1) =1, we have established that y(n) steadily decreases from | as n increases. 
Next, observe that 


[SF = ine) Paina) =f a] dt, hi bi 


1 t cit 2¢t gob 
Now, 
1 dt 1 
| eo 
ji ted 


because 4 steadily decreases over the integration interval and, taking the integrand 


as a constant equal to its greatest value in that interval, overestimates the integral. 
Thus, 


+ 


Cle 
| 
— 


1 
l 1 
n(n) << 1+ 5 
and so 


1 1 1 
(Pets gest = nin): 
0< tg tg Ta n(n) 


Adding 1 to both sides of this inequality, 


Die ae aioe dh ena SG) 
a 2 3 n-1 nee 


which, combined with our first result, says 
1 
0< ies y(n) <1. 


So, what we have shown is that y(n) is (for all n> 1) in the interval 0 to 1 and 
that, as n increases, y(n) steadily decreases from | without ever reaching 0. Thus, 
y(n) must approach a limiting value as n> oo. But what is that limiting value? 
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10 10' 10° 10° 10° 
Fig. 5.4.1 Euler’s constant as a limit 


Figure 5.4.1 shows a semi-log plot of y(n) = H(n) — In(n) as n varies over the 
interval | <n < 10,000, and y does appear to both exist (with an approximate value 
of 0.57) and to be approached fairly quickly. Such a plot is, of course, not a proof 
that y exists (we’ve already established that), but it is fully in the spirit of this book. 
By adding y to our catalog of constants, joining such workhorses as e, x, In(2), 
and G, we can now ‘do’ some new, very interesting integrals. 

I'll start by showing you how to write H(n) as an integral, and then we’ll 
manipulate this integral into a form that will express y as an integral, too. In the 
integral 


—— 


0 xX 


change variable to u= | — x (and so dx = — du) to get 
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1 n 0 1 1 ey aed n-1 
1-(1- 1-uw 1 14 t t ean 
| ( x) ax=| ns au) =|! u)( u+u’+u u ire 
0 x ; l-u 0 l-u 
1 
=|Qturweu's tu! bdu 
0 
1 1 
Lot ea BO Pa tah +s uP b| 
2 3 4 n 0 
1 1 1 1 
=14 t t t + — = H(n). 
2°34 oe 


Next, change variable in our original integral (an integral we now know is H(n)) 
to u=nx (and so dx = * du) and write 


0 — n 4) u 
n 
11 (1=2)" nt—(1-2) 
-| du +| du 
0 u 1 u 


We thus have 


v(a) = H(a) ~ in(n) = | au a i, Uae 


Letting n— 00, and recalling the definition of e" as 


: u\? 
e" = Hirmy se (1 +*) ; 
n 


we atrive at 


1-— 


(5.4.1) y = limy@) = i 
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The curious expression in (5.4.1) for y is extremely important—which is why 
I’ve put it in a box—and I’ll show you some applications of it in the calculations 
that follow. Checking it with quad, quad(@(x)(/-exp(-x))./x,0,1)-quad(@(x)exp 
(-x)./x,1,10) = 0.577219... 

To start, consider the integral 


ie e “In(x)dx 


which we can write as 


lo-e) 1 lo-e) 
(5.4.2) | e “In(x)dx = | e “In(x)dx + | e “In(x)dx. 
0 0 1 


Alert! Pay careful attention at our next step, where we’ll observe that 


This is of course true, but why (you are surely wondering) are we bothering to 
write the simple expression on the left in the more complicated form on the right? 
The answer is that we are going to do the first integral on the right in (5.4.2) by parts 
and, without this trick in notation, things will not go well (when we get done, you 
should try to do it all over again without this notational trick). 

So, continuing, we have for the first integral on the right 


which becomes, with 


u = In(x) 
and 
d 
dv = ae — 1)dx 


(and so du = + dx and v=e *— 1), 


i e “In(x)dx = | Ge — 1)In(x)dx 
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For the second integral on the right in (5.4.2) we also integrate by parts, now 
with u=In(x) and dv=e ~, and so 


So, 


oe) 1 - oe) 
1—e™* 1 
| e *In(x)dx = -| Bde | e “dx. 
0 x 1 2S 


By (5.4.1) the right-hand-side is —y (remember, I told you (5.4.1) would be 
important!) and so we see that 


(5.4.3) In e *In(x) dx =-y. 


Checking this with MATLAB, quad(@(x)exp(-x).*log(x),0,10) = — 0.57733.... 

Sometimes, particularly when reading an advanced math book, you’ll run across 
a comment that says (5.4.3) can be established by differentiating the integral 
definition of the gamma function I’(z) and then setting z= 1. If you write 


gots eln(x*"') = e (2-1 In(x) = eZin(x) a—In(x) 


it isn’t difficult to differentiate 


to get 
dr ' = 
(2) =T(z)= | e-*In(x)x’~! dx 
dz 0 
and so 
r()= | e “In(x) dx 
0 
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The authors of such books are assuming their readers are familiar with what 
mathematicians call the digamma function, which is° 


T (z) 1 co [1 1 
Viz) tee re (t- 
Setting z= 1 gives (because (1) =0!=1) 
t CO 1 1 
T(1)=-1l-yt+ — 
( ) Y ar € r+ :) 


eft 


or, 


as claimed and we get (5.4.3). 
Okay, let’s next consider the interesting integral 


i In{—In(x)} dx. 


Make the obvious change of variable u = — In(x) and fill-in the routine integra- 
tion by parts details to arrive at 


i In{—In(x)} dx = fe e “In(u)du 


which is (5.4.3). Thus, 


(5.4.4) jf. In{—In(x)} dx =-y. 


°T won’t pursue the derivation of Te , but if you’re interested you can find a nice presentation in 
Havil’s book (see note 5, pp. 55-58). We’ll use the digamma function in the final calculation of 


this chapter, the derivation of (5.4.11). See also Challenge Problem 5.10. 
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Checking with MATLAB, quad(@(x)log(-log(x)),0,1) = — 0.57721... . 


Another dramatic illustration of the power of (5.4.1) comes from the early 20th 
century mathematician Ramanujan (who will be discussed in more length in 
Chap. 9), who evaluated the exponentially-stuffed integral 


I= | ie te + ene 1 }dx 
0 


for @ any positive constant. Observing that the integrand is an even function, he 
started by doubling the integration interval and writing 


= | fe +e" — Ih dx 


and then changing variable to u= e* (and so dx = du). Thus, 


= | op eye, 
0 u 


Next, he broke this integral into a sum of two integrals: 
Dy 2 = a 
a=|'* m+ e neds | {: wt emu I 


du. 
0 u 1 u 


He then broke each of these two integrals into two more: 


1 u 
r —au _ 1 ‘a ‘CO e ou e a, 1 
21 = du + du + du 4 du 
0 0 u 1 u ', u 

1 _ 1 u nS u 
«J]—e™ eo ae l-e 

_ du + du?) + du du 
0 1 u 0 Uu 1 u 


Now, for the two integrals in the first pair of curly brackets make the change of 
variable x = au (and so du = 1 dx), and for the two integrals in the second pair of 
curly brackets make the change of variable x = ¢ (and so du = — dx). Then, 
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T 
co — 
X 


176 
tj ae lis ig e*(1, +f e*/_a, 
=> >.< >< —-— 7zdax 
a a o x? 
a 


[o.@) =X 


e 
dx 
x 


1 = 
_ x 
| : ax+| 
x 1 


oe) =% or? 1 —_ 
+| i dx | 7 dx. 
x 


Since the first two integrals on the right are —y by (5.4.1), then 


00 =x. 7 d 0? =—s 
21 = r+ © ax | *+| © ax 
a =X o xX 0 
or, combining the first and last integrals on the right, 
1o.@) —% 07 d 
4 | © ax | as 
0. o x 
Continuing, 
1 = ol = 1 1 
xX xX d d 
n= —y+{| = ax+| ax} {| is | =} 
0 xX 1 Xx go xX a xX 


1 2s 
x_ J 
ax+| ° dx “| 
0 xX a2 X 


= —y + | 
1 Xx 
CO Ae 1 

Xx _ 

dx | © dx + In(x)|..- 


e 
Xx 


| 


1 


The two integrals in the final pair of curly brackets are, again by (5.4.1), -y, and 


sO 
—2y — 2In(a). 


21 = —2y — In(o?) = 


Thus, finally, we have Ramanujan’s integral 
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(5.4.5) fo fer 2" + e= 2°" — 1}dx = -y — In(a). 


To check this, for « = | the integral is —y, while for «= 2 the integral is —y — In 
(2) = — 1.270362..., and MATLAB agrees as quad(@(x)(exp(-exp(x))+exp(-exp(- 
x))-1),0,100) = —0.577216... and quad(@(x)(exp(-2*exp(x))+exp(-2* exp(-x))- 
1),0,100) = — 1.270357.... 

As yet another example of (5.4.1), consider the following mysterious-looking 
integral: 


where a and b are both positive constants. This integral ‘looks like’ a Frullani 
integral (see Chap. 3 again), but it is not. It is much deeper. Without our equally 
mysterious (5.4.1) I think it would be impossible to make any headway with this 
integral. Here’s how to do it. 


0 x 0 x 0 
Let 
u=x* 
and so d 
u 
dx = ' 
axa-l 
Thus, 


Teu_] Seu | Sew _ | 
du + du du du 
u 


1 ew —] oe) ew 
y {| du + | aul | F 
0 u 1 U 


where once again (5.4.1) comes into play. 
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Next, in the two integrals on the right in the previous line, make the change of 
variable 


y=u 
and so 
du = 
Thus, 


1 .—uP oo .—uP | CO .— 
a Ms 1 yY—] y 
{| a au | : au} — {| : ay +| ay} 
0 u 1 u P Wo y 1 y 


and we have (where (5.4.1) is used yet again) 


[ ex" _ ee” 1 | 1 ths eu sis eu au} | 
dx = y La + 
0 x a p 


or, at last, 


(5.4.6) 


or, equivalently, 


And, in fact, MATLAB agrees, as 2*quad(@(x)(exp(-(x.42))-exp(-x))./x,0,100) 
= 0.5772153.... 


5.4 Euler’s Constant and Related Integrals 179 


Our result in (5.4.1) is so useful that I think it helpful to see it developed in an 


alternative, quite different way. We start with a result from earlier in the book, 
(3.3.3), where we showed that 


b CO _—axX __ a—bx 
In (2) = | ae 
a 0 Xx 


In particular, if we set a= 1 and b=t, we have 
SO eX _ etx 
(5.4.7) In(t) = | —— dx. 
Next, for n any positive integer, we have 


= 1 
| ee dx = (-ze™) 
0 n 


So, summing over all n from | to N, we have 


co 


o &-f 


1 i —nx i —nx 
i a ye | oe | pe - ax. 


The sum is a geometric series, easily evaluated to give 


s = ex — e7 (N+1)x 
1l—e™* 
Thus, 


dx. 


1 00 4-x _ a—(N+1)x 
(5.4.8) y =| iia 


n=1py 0 1-—e™~* 


Now, recall the definition of y from the beginning of this section: 


Y= tim Ee inn) 


Putting (5.4.7) and (5.4.8) into the expression on the right, we have 


oe eX — e7(Nt+1)x e7* — e Nx 5 
rte, {ep 


x 


and so 
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90 —x 1 4x oO 4—x 
=| e — dx {| : ax+| e ax} 
o l-e* 0 X 1 Xx 
In the first integral on the right, let's =1—e *.Then, gs =e “and so dx = os, 
Thus, 


or, 


which is just (5.4.1). 
Equation (5.4.1) isn’t the only tool we have for working with y, and to illustrate 
that let’s do the exotic integral 


| e-* In(x)dx 
0 


as the final calculation for this chapter. This will be a calculation that will require us 
to recall Feynman’s favorite trick from Chap. 3 of differentiating an integral, as 
well as the power series for the log function that we used earlier in this chapter. The 
answer will feature a (perhaps) surprising appearance of y. We start with a class of 
integrals indexed on the parameter m: 


(5.4.9) I(m) = iN xe dx, 


Differentiating with respect to m, 


did 


re m d ve 2 
Pucca =| Rules Je dx _ =| emln(x) a—x dx = | In(x)e™™™ e* dx 
dm dm 0 


0 dm 


and so 
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dl a 2 
—= | x™In(x)e * dx. 
dm 0 


This tells us that the integral we are after is the m=0 case, that is, 
= dl 
(5.4.10) | e-* In(x)dx = — |m-o. 
m 


Next, returning to (5.4.9), make the change of variable t=x? (and so dx = i 


_ di 
= 7: Then, 


ee m dt 1 oe m_l 
I(m) =] t?e'——= >| e ' t?-2dt. 
= |, 2vt 2 Jo 


Recalling (4.1.1), this last integral is the gamma function I'(n) for the case of 
n—1=8—3} (forn =“). Thus, 


1_/m+1 
I = ~T {| ——— 
(m) =57(7) 
and so, from (5.4.10), 


(5.4.11) | e™ In(x)dx = 5 gat (*F) } 


To do the differentiation of the gamma function, recall the digamma function 
from earlier in this section, where we have 


ro anel LES (oy 


So, with z = ™+4, we have 


ar(®*) _ aes) _ aes) 


d(™t) ft dm ss dm 


That is, for the case of m=0, 
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d .(m+1 | -!r()| aya [2 5 
dm | 2 ae ane YT Lat |r pe 4 5 
i ie 2 
— i i 
val Yt De é 2r =) | 


and so, putting this into (5.4.11), we have 


(5.4.12) I e-* In(x)dx = iva|-2 —y+250" (;; — ~. )| 


0 


Now, concentrate on the summation 


ane: sai)-( 5) +(3 5) + (5 a) + 


Then, recalling the power series for In(1+x) that we derived at the start of 


Sect. 5.2, we see that 


1 1 11 
In(2) = 1 
n(2) +3 +5 
and so 
11 1 41 «21 ~=41 
.--=1—In(2 
aus Pen at n(2), 


which means 


a. f 1 1 
=1—In(2). 
am (= or + :) ay?) 


Putting this into (5.4.12) we have 


[. e-* In(x)dx = 5vil-2 —y+2{1 — In(2)}] 


or, at last, we have the beautiful 


(5.4.13) S, e~*’ In(x) dx = — <vn ly + 2In(2)]. 
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This is equal to — 0.8700577... and MATLAB agrees as quad(@(x)exp(-(. 
A2)).*log(x),0,10) = — 0.87006.... 


5.5 Challenge Problems 


(C5.1): Consider the class of definite integrals defined by 


where m and n are positive integers. I(m, n) exists for all such m and n since the 
integrand is everywhere finite over the interval of integration.’ Make a power series 
expansion of the integrand and then integrate term-by-term to arrive at an infinite 
sum that can be easily evaluated with a simple computer program (no use of 
MATLAB’s quad or any other similar high-powered software allowed!). If you 
have access to a computer, write a code to evaluate I(m, n) for given values of m and 
n. You can check your code by seeing if it gives the correct answers for those cases 
easy to do by hand (obviously, I(n, n) = | for all n). For example, 


1 1 2 


(2 =| = x= (14x)dx= ier | =15 
j > he Ne 7 2 0 : 


and 


1 4y-x | > du 
1(1,2) = | —«- Reet i In(2) = 0.6931. 


Then, use your code to compute, with at least the first six decimal digits correct, 
the values of I(5, 7) and I(7, 5). 


(C5.2): Show that 


where {x} is the fractional part of x. To give you confidence that this is correct, 
MATLAB calculates guad(@(x)(x-floor(x))./x..2,1,100) = 0.41861..., while 


7 At the upper limit the integrand does become the indeterminate fe but we can use L’Hospital’s 
=m x™! _om 
—n xa! n° 


rule to compute the perfectly respectable lim,_,; — = lim, 
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1 —y=0.42278 ..... Hint: you might find it helpful to look back at Chap. 1 and 
review the derivation of (1.8.1). 


(C5.3): If you really understand the trick involved in doing integrals with 
fractional-part integrands then you should now be able to show that the great 
nemesis of the great Euler, €(3), can be written as the quite interesting integral 


3 00 {x} 
BG) cH) mas 


To give you confidence that this is correct, recall that the value of C(3) is 
1.20205. .., while MATLAB calculates /.5-3*quad(@(x)(x-floor(x))./x..4,1,100) 
= 1.202018.... 


(C5.4): It can be shown (using the contour integration technique we’ll discuss in 
00 


dx 
Chap. 8) that | a){in’(x) +22) 
blows-up when a= 1, and so it isn’t immediately apparent what the value of the 
integral is when a= 1. The integrand, itself, doesn’t do anything ‘weird’ at a= 1 
however, and MATLAB encounters no problem at a= 1: guad(@(x)1./((x+1).*(log 
(x).42+pi2)),0,lel7) = 0.474... . Using the power series os ere for In(1 +x) 
for — i <x <1, show the actual ~ilue of the integral at a= 1 is 5 . (Notice that = 


= a oe in(ay a> 0. Each term on the right 


and ; ina) | individually blow-up in opposite directions as a— 1, either from betnaia or 


ae above, and so it is a priori plausible that their sum could be finite.) 


(C5.5): For the case of s = 2, (5.3.7) says that 


jane 1 1 1 1 1 
6(2 —— site yet at | 
1 1 1 1 
=2) 72 * 32 gat 


1 _ 1 : 
Thus, it must be true that 
1 1 1 1 1 1 1 1 
2\72 72 t 32 ere =p mg? et 
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Starting with the expression on the left, show that it is, indeed, equal to the 
expression on the right. 


(C5.6): Show that 


Hint: try the change of variable 1 — x =e’ ‘, and then remember (5.3.4). 
1 Pp 
—I 
(C5.7): Show that | EO =T(p+1)¢(p+ 1), p> 0. Notice that the 
0 —xX 
1 —In(x) 2 
case of p= 1 says C(2) = i dx = % = 1.644934... and MATLAB agrees: 
0 —xX 
quad(@(x)-log(x)./U1-x),0,1) = 1.64494... . Hint: Make the appropriate change of 
variable in (5.3.4). Notice, too, that if you make the change of variable u = 1—x then 
the result for p= 1 gives another derivation of (5.2.2). You should confirm this. 


1 pl 
1 
(C5.8): Right after deriving (5.3.1) we showed that | | i dx dy = €(2). 
oJo + — xy 
Show that this is the n=2 special case of a more general integration over 
an n-dimensional unit hypercube. That is, show that 
1 pl 1 
1 
2.2 |) —————__ dx dx2.... dx, = ‘ 

I I I 1 — XjX2..-Xp ei: ‘i S(n) 

oe Ge 1 2 
(C5.9): Show that | In (: i ax =7 

ft) ex — |] 
(C5.10): Show that | e “In?(x)dx = y? +E, MATLAB agrees with this, as y7 

0 


+= equals 1.978111..., and quad(@(x)exp(-x).*(log(x).42),0,100) = 1.97812... 
Hint: Start with I(m) = [exer “dx and then think about how to express I(m) as the 
second derivative of a gamma function. To do the differentiations involved, you’ll 
need to apply a double dose of the digamma function. 


1 = 1 
inet 
(C5.11): Starting with (5.4.1), show that y = | © © * ax. This is a partic- 


0 xX 

ularly useful expression for y because, over the entire finite interval of integration, 
the integrand is finite. MATLAB computes the integral as quad(@(x)(1-exp(-x)-exp 
(-1./x))./x,0,1) = 0.577215.... 


Chapter 6 
Seven Not-So-Easy Integrals 


6.1 Bernoulli’s Integral 


As I mentioned in the Preface, in 1697 John Bernoulli evaluated the exotic-looking 


integral 
1 
| x*dx. 
0 


How can this be done? And what about other similar integrals, ones that 
Bernoulli’s integral might inspire, like 


I 
| x *dx 
0 
and 
i 
| x* dx 
0 
and 
1 
| xV*dx 
0 


and ... well, you get the picture! In this opening section Ill show you a unified way 
to do all of these calculations. 
We start with the identity 


xox" = eln(x™") = eoX'In(x) 
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where a and c are constants. Then, since the power series expansion of the 
exponential is 


2 3 
yea 
y ahs 
e Ley oy ay tT 


then, with y = cx" In(x), we have 


a 1 1 
x™ = 1+ cx*ln(x) + —c?x™In?(x) + —c?x*In3 (x) 4 --- 


2! 3! 
and so 
_— 1 1 2 fl 
| x ax = | ax+e| x'in(xjdx +5 | x”"In? (x)dx 
0 0 0 2! Jo 
3 fl 
(6.1.1) +5 x°4Jn3(x)dx +... 
‘Jo 


You can do all of the integrals in (6.1.1) if you did the challenge problem I gave 
you at the end of Chap. 4: the derivation of 


t n! 
[x In"(x)dx = (—1) (eT 


If you didn’t do this (or got stuck) now is a good time to take a look at the Challenge 
Problem solutions at the end of the book. All of the integrals in (6.1.1) are of this 
form, with different values for m and n.! 

Using this general result on each of the integrals on the right-hand side of (6.1.1), 
we atrive at 


i ‘iK=1 c - 2! ce 3! e 4! 
x dx = sa .o 
0 atl)? 2) | Gat?) ShiiG@etiy" | 4 | Gaaeiy 


Cc Cc Cc , Cc 
“(Qa+1)) Gatti)? (4at+1) 


6.1.2 | x*dx = 1 
( ) 0 (a+ 1) 


'This is not the way Bernoulli did his original evaluation, but rather is the modern way. The 
evaluation of [ §x™ In"(x)dx that I give in the solutions uses the gamma function, which was still in 
the future in Bernoulli’s day. Bernoulli used repeated integration by parts, which in fact is 


perfectly fine. The lack of a specialized tool doesn’t stop a genius! 
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So, with a=c=1 we have Bernoulli’s integral: 


(6.1.3) 


It is easy to write a little program to sum the right-hand side; using the first ten 
terms, we get 0.78343. .., and in agreement is quad(@(x)x.x,0,1) = 0.78343... . 
If c=— 1 and a= 1 then (6.1.2) becomes 


= il 1 1 1 
(6.1.4) Ie at Seba tte. 


Summing the first ten terms on the right gives 1.29128. .., and in agreement is 
quad(@(x)x.(-x),0,1) = 1.29128... . By the way, since (6.1.4) can be written as 


Pe co I 
ox* nD iige 


it is sometimes called the sophomore’s dream because, while the similar forms on 
each side of the equality ‘look too good to be true,’ it is a true statement. 
If c=1 and a=2 then (6.1.2) becomes 


(6.1.5) 


Summing the first six terms on the right gives 0.896488... and MATLAB agrees as 
quad(@(x)x.\(x.2),0,1) = 0.896487... . 
If c=1 and a = 5 then (6.1.2) becomes 


I 
1 1 1 1 
| x*dx = 1 7 Pi 


0 GG) 


or, 


(6.1.6) 


Summing the first ten terms on the right gives 0.658582... and MATLAB agrees as 
quad(@(x)x.Asqrt(x),0,1) = 0.658586... . 
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6.2 Ahmed’s Integral 


In this section we’ll do Ahmed’s integral, named after the Indian mathematical 
physicist Zafar Ahmed who proposed it in 2002. Interesting in its own right, we'll 
also use it in the next section to do the derivation of Coxeter’s integral that I 
mentioned in the Preface. Ahmed’s integral is, 


i tan-! (1/2 + x2) F 


ee ose Wire” 


and it can be done using Feynman’s favorite trick of differentiating under the 
integral sign. That is, we’ll start with a ‘u-parameterized’ version of (6.2.1), 


7 i tan ~! (u/2 + x?) 4 


(6.2.2) 
0 (14+x)V2+x2 


2 


and then differentiate it with respect to u. I(1) is Ahmed’s integral. 
Notice that if u— oo then the argument of the inverse tangent also — oo for all 


F T 
x >0 and so, since tan~!(o0) = > we have 


xf! dx 
ze) Hoo) =5 |, (+x) vare 


The integral in (6.2.3) is easy to do once you recall the standard differentiation 


formula 
d 4 1 df 
— tan {f(x)} =—,—_ [| — ]. 
dx ted} 1+ f(x) (5) 


If we use this formula to calculate 


then you should confirm that 


d “4 x 1 
— tan = 
dx ist (1 +x2)V/2 + x? 


which is the integrand of (6.2.3). That is, 


6.2 Ahmed’s Integral 


Hoo) = 3 ge) are po = 5 | tt os 
== | tan-! s — tan ‘{0}] =| = | 
or, 
1(o0) =. 


Now, differentiate (6.2.2) with respect to u, again using 


; : 7 1 df 
qx fan tf(u)} = 14+ f(u) (a) 


with f(u) = uV/2 4+ x?. Then, with just a bit of algebra, 


dl 


i dx 
du Jo (1+ x2)(1 + 2u? + v2 x2) 


With a partial fraction expansion this becomes 


| 1 1 w 
du Jo(1+u2) |1+x? 14+2u?4 0? x? 
or, 


dl 1 


du (1+ wu?) 


i dx i dx 
ol+x? Jo Me +x 


These last two integrals are each of the form 


dx eS _1/X 
e+e a 6 


and so, doing the integrals, we have 


a ! tan! (x) 7 tan! i 
du (1+ w?) V1 + 2w 


Jo 


v14 2u2 
or, 
dl 1 T u u 
6.2.4 = tan! (a) 
( ) du (1 + u?) F J1 + 2u2 V1 + 2u2 
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Next, integrate both sides of (6.2.4) from 1 to oo with respect to u. On the left 
we get 


and on the right we get 


n(~ du = u 4 u 
tan ———— ]}du 
Ail La | (1 +u2)V/1 + 2u? (ae) 
The first integral is easy: 


cf du hey A by p 
of eee -t Dn) =F 5-4] ==. 
‘| Tew = 4 tan (oo) — tan") = 7 5 — al = 16 
Thus, 


2 


(625) K(oo) I) = | anayrree ae) 


That final integral looks pretty awful—but looks are deceiving. The integral 
yields with not even a whimper if we make the change of variable t = 1 (and so 
du = —3 dt) as follows: 


ig u 4 u 
tan ———— }du 
I (1 + u2)V1 + 2u2 (ie) 
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Now, recall the identity 


1 T 
tan! tan“'(—) == 
an” ‘(s) + tan (*) 5 


which becomes instantly obvious if you draw a right triangle with perpendicular 
sides of lengths 1 and s and remember that the two acute angles add to 5. This says 


1 
tan ~!(E-) =5- tan ~( +2) 
t+ 


and so we can write 


: 1 1 

—1 
joa dt 
o(?+1)Vv?4+2 +2 


a) dt i tan —! (Vt? + 2) 


2Jo(@+1)V2F+2 Jo(t?+1)v2+2 


That is, (6.2.5) becomes 


2 


(oo) — (1) x al dt +f tan! (vt? + 2) 
oe) = 
16 2Jo (2 4+1)¥24+2 Jo (2 +1)Vt?2 +2 


and you should now see that two wonderful things have happened. First, if you look 
back at (6.2.3) you’ll see that the first integral on the right is I(co). Second, the right- 
most integral, from (6.2.1), is just I(1), that is, Ahmed’s integral! So, 


1 
I(oo) —1(1) = = — (ov) + I(1) 


16 
and so 
2I(co) — ie = 2I(1) 
16 
or, at last, 
2 2 a 
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and we have our answer: 


i tan71(v2 + x?) _ 51” 


6.2.6 pach SLM = 
( ) O (1+ x2)V2 + x2 96 


This is equal to 0.51404189 ...,and MATLAB agrees, as quad(@(x)atan(sqrt(2 
+x.42))./(14+x.42).*sqrt(2+x.42)),0,1) = 0.51404188.... 


6.3 Coxeter’s Integral 


In this section we’ll do the integral that the young H. S. M. Coxeter pleaded for help 
with in the Preface, a plea which the great Hardy answered. I don’t know the details 
of what Hardy sent to Coxeter, and so here I’ll show you an analysis that makes use 
of (6.2.6). The integral we are going to evaluate is 


(6.3.1) I= fe cos 


and it will be a pretty long haul; prepare yourself for the longest derivation in this 
book. I’ve tried to make every step crystal clear but still, in the immortal words of 
Bette Davis in her 1950 film A// About Eve, “Fasten your seatbelts, it’s going to be a 
bumpy night.” 

To start our analysis, we’ll cast (6.3.1) into a different form. The double-angle 
formula from trigonometry for the cosine says that, for any 0, 
(6.3.2) cos (20) = 2.cos(@) — 1. 

If we write u=cos(0)—and so @= cos” '(u)—then (6.3.2) says that 

cos (20) = 2u* — 1, 
from which it immediately follows that 
cos! (2u° — 1) = cos~!{ cos (20)} = 20 = 2cos~"(u). 


So, since u is simply an arbitrary variable (as is 8) we can write 


(6.3.3) cos! (26 — 1) = 2cos~'(6). 
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Next, writing a= 207 — 1 (which means 0 = , /'3) , we have from (6.3.3) that 


1 
coxa) = 2608 *), 


Looking back at (6.3.1), let’s write 


cos (x) 


aa + 2cos (x) 


and so we have 


4s cos (x) 2. 
“oe cos (x) Le an5-t 126080) | _ 9 ogg-1 1 + 3cos (x) . 
1 + 2cos(x) 2 2+ 4cos (x) 


(6.3.4) 


Now, if you apply the Pythagorean theorem to a right triangle with an acute 


1+3 cos (x) 


angle whose cosine is 4/5 toca you'll see that the tangent of that same angle is 


l+cos(x) That is, 


1+3-cos (x) 
Pane cos (x) pact 1+ cos (x) 
1 + 2cos (x) 1 + 3cos (x) 


and so Coxeter’s integral I in (6.3.1) becomes 


(6.3.5) i= af wf +O 


0 1 + 3cos (x) 
Make the change of variable x = 2y (and so dx = 2dy) which converts (6.3.5) to 
/4 1 2 
I= 4 tan! fe (2y) dy. 
0 1 + 3cos (2y) 
Using (6.3.2) again, and then applying a bit of algebraic simplification, we have 


1+ cos (2y) cos (y) 


1+3cos(2y) \/2— 3 sin2(y) 
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and so 


oi Cos 
(6.3.6) I= 4 tan! {paps ba 


Now, put (6.3.6) aside for the moment and notice the following (which may 
appear to be out of left-field, but be patient and you’ll see its relevance soon): 


1 
1 
— 
O14 cos val 2 


2 —3sin2 


is of the form 


rey a 1 1 
| t= | i= ieee) Sa) po 
colt be Iot 2b b 2—3sin2(y) 
b2 
Thus, 
: 1 2 —3sin2 
| : aps sin?(y) ae cos y) 
O14 je t cos (y) 2 — 3sin?(y) 


That is, the integrand of (6.3.6) is given by 


1 
re cos (Y) = cos (Y) | 1 a 
/2 — 3sin2(y) /2 —3sin2(y) Jo 1+ Peele 


2 —3sin? 


and so (6.3.6) is, itself, the double integral 


1/4 : 1 
(6.3.7) oa ‘| Th wae S 
0 /2-—3sin?(y) | Jo14 [PSeal? 


Wow! This may look like we’ve made things (a lot) worse. Well, hang in there 
because they’re going to appear to get even worse before they get better—but they 
will get (a lot) better, although not for a while. 
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Continuing, we have 


=f 4cos (y) {2 — 3 sin?(y) } aay 
0 Jo 1/2 —3sin*(y){2 — 3 sin?(y) + t? cos?(y)} 

_ 7/4 (1 Acos (y)\/2 — 3 sin2(y) dtd 

= ae Penta. 

0 Jo2—3sin*(y) + t? —t? sin?(y) 
or, 
7/4 tl Acos (y),/2 — 3 sin2(y) 
6.3.8 I= dt dy. 
ae I, J, wera fer aang5*” 
Next, make the change of variable sin(y) = ,/$sin(w) in (6.3.8), and so 


dy = \3 ee dw. We have w=0 when y=0, and when y = % we have sin () 
v3 


= 7 and so sin(w) = ( 3) (3) = s which says w = 3. So 


2 

2/3 1 4cos(y),/2 — 3=sin?(w) 
=[" | y = dt =e 

9 10(242)-(C+3)zsin2(w) S80) V3 

x/3 pl 4,/2 — 2/1 — cos?(w)} 2 
~ I | 2 2 2 7 - cm (whom 

(842) = 4 ELL ~ om) 

| 1 4V2cos (w)V2cos (w) 


°(P?+2)-(?+ 3); [1 — cos ?(w)] 


1 
dt dw 
V3 


and, after some straightforward algebra which I’m going to let you fill-in, we 
arrive at 


(6.3.9) dt dw. 


I= ia 8/3 cos ?(w) 
— 0 0 t? + (2t? +6) cos 2(w) 


Our next step is another change of variable, to s=tan(w). Thus, as 


tan (w) = aes we have 


ds _ cos*(w) + sin*(w) 1 


dw cos 2(w) ~ cos2(w) 


> 
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and so dw = cos?(w) ds. Since 


sin?(w) | 1 


1+s?=1+ tan*(w) =1 
oe qe) = cos?(w) cos?(w) 


we have 
1 
ae cos 7(w) 
and so 
d 
dy 
1+ s2 


Therefore, since s =0 when w= (0, and s = V3 when w = - we have 


” i f 8V3745 ds 


dt 
90 + (2? +6)-13 1+s? 


7 i i 8V3 


0 2 (1+s2)? + (212 + 6)(1 +52) 


0 


dt ds 


0 


or, after again some more straightforward algebra which you can do, we arrive at 


(6.3.10) dt ds. 


[Lames 
~ Jo Jo (1 +8?)( 2s? + 3 2 + 6) 


Krusty the Clown on the Simpson’s TV cartoon-comedy show is fond of yelling, 
when frustrated, “Will it ever end?,” and the answer here is, ‘Not yet.’ So, bravely 
plowing-on, let’s now make a partial fraction expansion of the integrand in (6.3.10). 
That is, if we write 


1 A, B 
(1+s2)(?s?+312+6) 148? ts?4+3t46 


it is then easy to confirm that 


1 2 
~ FD B= 2 
2t7 +6 2t- +6 


and so 


1 fg 
22+6 27+6 
dt ds 
l+s? s?+30?+6 


1-[" [v3 


0 0 
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which with just a little algebra (and a reversal of the order of integration) can be 
written as 


(6.3.11) 1=[ #2 fr = i = dt 
a Jo PH+3)Jo 14s? Jo 824+34+5f - 


The first inner integral on the right is easy: 


{ tan (s) }|V3 — tan ~'( v3) =7. 


The second inner integral is almost as easy, as it is equal to 


S 
i ds 1 = 


= 1 6 
: 5) ra tan ea 
24 | ps] ote V t 


Thus, 


‘4/3 |x t 7 ae | 
=|5 tan dt 
oP+3)3 V3V2+2 


ane iu 4 | : tan! : dt 
_ 3 0 t2 2 2 3 2 2 2 2 

+ (v3) o | (7 +3)Vt+ t+ 
4V/3n} 1 if t ) 
— n 


or, as 


“tae G)} 


we have 


2n* : i t 
(6.3.12) I= 4| tan! (<5) dt 
9 o | (2 4+3)42 +2 +2 
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We are now in the homestretch, as we can do the integral in (6.3.12) by parts. 


To see this, let 
"(Gee) 
u= tan ——. 
42 


t 
dv = ——___——- tt. 


(t?+3)V?+2 


and 


Then, remembering how to differentiate the inverse tangent from the opening 
discussion of this section, we have 


And you can verify that 
v= tan ~( ig +2) 


by simply differentiating this v and observing that we get the above dv back. So, 
plugging all this into the integration by parts formula, we have 


1 
Qn? t Mtan (Vt? +2 
pS a = tan~( +2) | ( ) at 
9 vt +2 o(t?+1)V?+2 
Qn? 1 M tan! (Vt? +2 
a tan~!(—) tan (v3) | an ( + Vs 
9 V3 o(t?+1)Vvt?+2 
_ 2n* al (2) (4 i tan! ( r+2) . 
? 6} \3 o(?+1)vt? +2 
_ on? 2x af tan! (//t? + 2) se 
~ 9 9 Yo (2 + 1)? +2 
and so, 


' tan! (Vt? + 2) 
i=4] —__\-__“ dt 
0(?4+1)Vv +2 


Now, look back at (6.2.6), our result for Ahmed’s integral. It is precisely the 
above integral. Coxeter’s integral is four times Ahmed’s integral and so, at last (!), 
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(6.3.13) 


cos(x) } me 


1 + 2cos(x) 


Wow! What a derivation! But is it correct? MATLAB says it is, as our theoret- 
ical answer of 2.05616758... matches quad(@(x)acos(cos(x)./U+2*cos(x))),0, 
pi/2) = 2.0561677.... 


6.4 The Hardy-Schuster Optical Integral 


In 1925 the German-born English physicist Arthur Schuster (185 1—1934) published 
a paper on the theory of light. In that paper he encountered the intriguing integral 


(6.4.1) j= ik {C?(x) + S?(x) }dx, 
0 


where C(x) and S(x) are themselves integrals (called Fresnel integrals, and we’ ll 
see them again in the next chapter for the special case of x = 0): 


CO 


C(x) = [- cos (t”)dt, S(x) = | sin (t”) dt. 


xX x 


In fact, since we’ll eventually need to know one of these two specific values—S 
(0)—to find J, here is its value now (we'll derive it in the next chapter as result 
(7.2.2)): 


(6.4.2) S(0) = |" sin (2)dt => ,/%. 


Schuster was unable to evaluate J, but did write that the physics of the problem 
he was studying would be satisfied if J had a certain value. Alas, he couldn’t show 
that J had that value and that is where he left matters. 

Schuster’s paper soon came to the attention of the great Hardy, who then (are 
you surprised and if so, why?) quickly computed J (confirming Schuster’s conjec- 
ture) using two different approaches. One of them used sophisticated Fourier 
transform theory,” but in this section Pll show you an alternative ‘freshman 
calculus’ derivation that freely uses the physical interpretation of the Riemann 
integral. It is based on an idea that Hardy himself sketched in his other approach. 


? For a detailed discussion of Schuster’s integral and Hardy’s transform solution, see my book 
Dr. Euler’s Fabulous Formula, Princeton 2006, pp. 263-274. 
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From the definitions of C(x) and S(x) we can write 


CH= [- cos (P)ar] cos (u”)du = | [- cos (t”) cos (u*)dt du 


x x x x 


and 


$7(z)'= [- sin (P)ar] sin (u’)du - [- li sin (t’) sin (u’)dt du. 


Xx 


Thus, 


C(x) + S?(x) = [- [- { cos (t) cos (u”) + sin (t”) sin (u’) } dt du. 


From trigonometry we have the identity 
cos (a — b) = cos (a) cos (b) + sin (a) sin (b) 


and so it immediately follows that 


C(x) + S*(x) = [- [- cos (t? — u’)dt du. 


Xx Xx 


From (6.4.1) we then have 


(6.4.3) i= ie Me [- cos (t” — u°)dt dua 


0 x Jx 


(At this point you should take a look back at Sect. 3.6, where I showed you how to 
use MATLAB’s Symbolic Math Toolbox to numerically evaluate this triple 
integral.) 

Let’s now agree to write f(t, u) = cos(t” — uw’), and so (6.4.3) becomes 


(6.4.4) J= |. {{- i f(t,u)dt aukax 


We can express in words what (6.4.4) says as follows: The outermost integral 
(x) says ‘starting with x = 0, evaluate {fo i f(t, u)dt du} Ax. Then, increment x by 
Ax to x= Ax and evaluate tie ie f(t, u)dt du}Ax. Then increment x by Ax to 
x = 2Ax and evaluate ase bie f(t, u)dt du} Ax. And so on. Then add all of these 
evaluations.’ 

We can reformulate this mathematical interpretation of (6.4.4) as a physical one 
by assigning the three variables x, t, and u to the axes of a three-dimensional 
Cartesian coordinate system, as shown in Fig. 6.4.1, where the x and u axes are in 
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the plane of the page and the t-axis is perpendicular to the page (the positive t-axis is 
into the page). 

Each of the individual integrals in our sum is simply the integral of f(t,u) over the 
volume of an infinite ‘slab’ of thickness Ax, where the ‘bottom’ slab’s comer’ starts 
at the origin (t=0, u=0). The corners of the subsequent slabs lying above the 
bottom slab are gradually slid up (along the x-axis) and away from the origin along 
the line t=u. So, if you imagine yourself in space, hovering over the t,u-plane and 
looking down along the x-axis, Fig. 6.4.2 is what you’d see. That is, the volume we 
are integrating f(t, u) over looks like a layered wedding cake! The steps formed by 
the layers have height and depth Ax. (For a carpenter building a staircase, these 
would be the values of the riser and the tread of the steps, respectively.) That is, 


3 Since the volume we are integrating over is infinite in extent in both the t and u directions, the 
corner at the origin is the only corner of the bottom slab. 
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Fig. 6.4.3 The foot of the x 
wedding cake at the origin 


(6.4.5) J= | f(t,u) dV 
cake 


where dV is the differential volume of the wedding cake. 

In a side view of the cake (now with Ax — 0), the corner of the cake at the origin 
looks like the foot of a pyramid, as shown in Fig. 6.4.3. 

There is another way, different from (6.4.4), to write the integral of f(t, u) over 
the wedding cake volume. To start to set this new form up, notice that if we cut the 
cake with a plane perpendicular to the t,u-plane (the base of the cake) with the plane 
passing through the line t= u, then we cut the cake into two equal parts. In one half 
we have u<t (I'll call this the upper half) and in the other half we have u>t (I'll 
call this the Jower half), as shown in Fig. 6.4.2. 

We first pick a tiny rectangular ‘footprint’ dtdu in the t,u-plane, at (t, u). Then, 
we move upward (increasing x direction) until we hit the surface of the cake. For a 
given u and t (the location of the ‘footprint’) this occurs at height x = min(t,u). If the 
footprint is in the lower half then min(t,u) = t, and if the footprint is in the upper half 
then min(t,u) =u. In either case, the differential volume of this vertical plug 
through the wedding cake is given by 


min(t,u) . 
_ — udtdu, u <¢ (upper half) 
(O48) ov if osha ~ tdtdu, u >t (lower half) 


For u > t (lower half) we have u varying from 0 to oo and t varying from 0 to u. 
So, for the case of u >t the integral in (6.4.5) is 


Shower = | {| t f(t, vjat ba, 
0 0 
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For u<t (upper half) we have t varying from 0 to oo and u varying from 
0 to t. So, for the case of u<t the integral in (6.4.5) is 


[e-e) t 
Jupper = | {| u f(t, udu ba 
0 0 


Thus, 


oe) u ioe) t 
J = Shower + Jupper = | {| t f(t, war} du +| {| uf(t, wjau a 
ed 0 0 2 , 20 0 
=| {| tcos (?-u')at} au | {| ucos (° —2)au har, 
0 0 0 0 


These last two integrals are obviously equal since, if we swap the two dummy 
variables t and u in either integral, we get the other integral. So, 


loe) t 
J= 2| {| ucos (t? = w)auhan 
0 0 


The inner integral can be integrated by inspection: 


[_uc0s (? —u’)du = \-3 sin (12 — vy} 


0 


eo 
+ 2 
=; sin(t Ve 


0 


and so 


which is just S(O). That is, 


(6.4.7) ince tee cos(t? — u?) dt du} dx = : 


This is 0.626657... and, as shown in Sect. 3.6, that’s what the Symbolic Math 
Toolbox calculates as well. 
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6.5 The Watson/van Peype Triple Integrals 


In 1939 the English mathematician George N. Watson (1886-1965) published an 
elegant paper* in which he showed how to evaluate the following three integrals: 


n=a] [| du dv dw . 

™ Jo Jo Jo 1 — cos (u) cos (v) cos (w) 

b=a[ [| du dv dw . 
™ Jo Jo Jo 3 — cos(v) cos (w) — cos (w) cos (u) — cos (u) cos (v) 


b=s[ [| du dv dw 
>" 3 Jo Jo Jo 3 — cos (u) — cos (v) — cos (w)’ 


These three integrals were not pulled out of thin air, but rather all had appeared in a 
paper’ published the previous year by W. F. van Peype, a student of the famous 
Dutch physicist H. A. Kramers (1894-1952). Van Peype was able to evaluate I, but 
not I, or I;. Kramers was apparently sufficiently fascinated by these integrals that he 
sent them to the British physicist Ralph Fowler (1889-1944) who, apparently also 
stumped, passed them on into the hands of—who else?—G. H. Hardy, famous 
slayer of definite integrals. 

At this point, matters become interesting beyond just mathematics. As Watson 
wrote in the opening of his paper, “The problem then became common knowledge 
first in Cambridge [Hardy’s lair] and subsequently in Oxford, when it made the 
journey to Birmingham [Watson was on the faculty at the University of Birming- 
ham] without difficulty.” Perhaps I am reading too much into that, but I suspect this 
was one of those rare cases where Hardy failed to evaluate a definite integral, and 
Watson was only too happy to (not so subtly) allude to that as he started to present 
his solutions. Birmingham was small potatoes compared to Cambridge, and I think 
just a bit of friendly ‘in your face’ was involved here. 

Watson’s analyses of I,, I,, and Iz are quite clever. Watson wrote that I, and I, 
“are easily expressible in terms of gamma functions whose arguments are simple 
fractions,” but he was not able to do that for I3. Iz, he suspected, required the use of 


4G. N. Watson, “Three Triple Integrals,” Quarterly Journal of Mathematics, 1939, pp. 266-276. 


>W. F. van Peype, “Zur Theorie der Magnetischen Anisotropic Kubischer Kristalle Beim 
Absoluten Nullpunkt,” Physica, June 1938, pp. 465-482. That is, van Peype was studying 
magnetic behavior in certain cubic crystalline lattice structures at very low temperatures (/ow 
means near absolute zero). The Watson/van Peype integrals turn-up not only in the physics of 
frozen magnetic crystals, but also in the pure mathematics of random walks. You can find a 
complete discussion of both the history and the mathematics of the integrals in I. J. Zucker, “70+ 
Years of the Watson Integrals,” Journal of Statistical Physics, November 2011, pp. 591-612. 
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elliptic integrals,° mathematical creatures Ill say a little bit more about in the next 
section. In this belief, Watson was wrong. In fact, 


mG) 
I, = = 1.393203929..., 
4n3 
31° (3) 
L= a4 = 0.448220394..., 


16/6n3 


To give you the ‘flavor’ of what Watson did, I'll take you through the derivation 
for I,. Before starting, however, notice that all three integrals are volume integrals 
over a three-dimensional cube with edge-length 2, normalized to the volume of that 
cube. I'll ignore the normalizing x until we get to the end of the analysis. 

We start with the change of variables 


=t : = Ti t = ft ! 
x = tan zu), y= tan AV), 2= tan AW 


which convert the 0 to x integrations in u, v, and w in J, into 0 to oo integrations in 
X, y, and z, respectively. Now, since 


u = 2tan~'(x) 


then 


6 : 1 a) : Bde oh . 7 
Integrals with the integrands eae" k* sin?(8) are elliptic integrals of the first and 


second kind, respectively (there is a third form, too). Such integrals occur in many important 
physical problems, such as the theory of the non-linear pendulum. As another example, the Italian 
mathematical physicist Galileo Galilei (1564-1642) studied the so-called “minimum descent 
time” problem, which involves an elliptic integral of the first kind, and its evaluation puzzled 
mathematicians for over a century. Eventually the French mathematician Adrien Marie Legendre 
(1752-1833) showed that the reason for the difficulty was that such integrals are entirely new 
functions, different from all other known functions. You can find more about Galileo’s problem, 
and the elliptic integral it encounters, in my book When Least is Best, Princeton 2007, pp. 200-210 
and 347-351. A nice discussion of the non-linear pendulum, and the numerical evaluation of its 
elliptic integral, is in the paper by T. F. Zheng ef al., “Teaching the Nonlinear Pendulum,” The 
Physics Teacher, April 1994, pp. 248-251. 
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or, 
Similarly, 


and 


2 


dy eee 
” 14+ 22 


dz. 


Also, from the half-angle formula for the tangent, we have 


1 1 — cos (u) 
tan | <u |) = ,/————_"~ =x 
2 1+ cos (u) 


and so, solving for cos(u), 


1—x? 
cos (u) = mee 
Similarly, 

1— 2 

cos (v) = : 

l+y? 

and 

1-2? 
COS (w) = ‘aig : 


Putting these results for the differentials, and the cosines, into the I, integral 
(remember, we are temporarily ignoring the normalizing 1°), we have 
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dx dy dz 
2 2 2 
re daddy ree 1+x l+y 1+z 
=8 
0 Jo Jo 1 — cos(u) cos(v) cos(w) o Jo Jo ee: 1-y? 19 


aal tt dx dy dz 
=3[/ if i (+e)\0+y)0+2)-( x) -y (1-22) 


which, after a bit of multiplying and combining of terms in the denominator, 


reduces to 
af [| dx dy dz 
0 Jo Jo Xe +y? +22 4+ x? yz?" 


Notice, carefully, that this is a volume integral over the entire positive octant 
(x > 0, y > 0,z > 0) in three-dimensional space. 
Next, change variables again as follows: 


x = rsin(9) cos (), y = rsin(6) sin (), z = rcos(6) 


which is, physically, simply a shift to spherical coordinates from the rectangular 
coordinates in our last integral.’ To continue to be physically integrating over the 
entire positive octant in three-dimensional space, we see that our triple integral, 
with differentials dr, d8, and dd, must be over the intervals 0 to oo, 0 to¥, and 0 to - 
respectively. The differential volume element in rectangular coordinates (dx dy dz) 
becomes the differential volume element r* sin(@)dq dé dr in spherical coordinates. 
Thus, in this new coordinate system the I, integral becomes 


Fi ie i ii 1 sin (0)dd dO dr 
o Jo Jo rsin?(@)cos?() +r’ sin(0) sin?(p) 
+ 1° cos?(0) + r° sin?(8) cos?() sin?(®) sin?(q) cos (8) 


= Nee (ae (ee sin (0)dd dO dr 
7 I | j 1 + 14 sin4(0) cos (6) sin 2() cos 2() 


7 In this notation, the angle ¢ is measured from the positive x-axis and 0 is measured from the positive 
z-axis. Some authors reverse this convention, but of course if one maintains consistency from start to 
finish everything comes out the same. The symbols are, after all, just squiggles of ink. 
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or, with the order of integration explicitly displayed, 


-4[" i Nero oro) joo) 


Now, define the variable 


w = 26. 


Then, the double-angle formula for the sine says 


sin (dp) cos () = ; sin (2) 


and so 
2 2 Le Lo 
sin “() cos “() =7 sin (2) =7 sin (w). 
Since 
Ased 


our integral then becomes 


m ( pr/2 [ poo sin (8) 
2 if tf 1 + 41+ sin4(0) cos ?(0) sin?(w) schoo 


At this point things may superficially appear to be bordering on the desperate 
but, as the old saying goes, ‘appearances can be deceptive’; we are actually almost 
done. First, the outer-most integration (with respect to w) is symmetrical in wy 
around yw = 5. That is, as Watson says in his paper, 


SPC oaw= PCa.” 


which is, of course, the result of y appearing in the integrand only as sin?(y). Thus, 
our integral becomes 


/2 /2 00 sin (0) 
a] if 1) 1 + 41+ sin4(8) cos ?(8) sin?(w) haa 
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Second, Watson uses the fact that the inner-most (that is, the first) integration 


(with respect to r) is performed for 0 and yw held fixed. That is, in the change of 
variable 


t = rsin (0) ; cos (0) sin (wy) 


t is actually a function only of just r, and not of r, and 8, and w. So, making that 
change we have 


dt 
sin (8) ,/5 cos (8) sin (w) 


dr = 


and 
ae oe eee 29) cin2 
t =r sin (8) cos *(8) sin“(y), 


which converts our integral to 
/2 a /2 00 
sin (0) 


0 0 » sin ONE cos (8) sin (w) (1 + t*) 


4 


dt $d0 Sdy 


= wif ‘i if : dt \aohay 
0 0 0 «/ cos (0),/ sin (yw) (1 + t*) 


a scary-looking object that—suddenly and with unspeakable joy to the analyst*— 
separates into the product of three one-dimension integrals, each of which we’ve 
already done! That is, we have 


[Ci-actionteams tL aral erm vant 


81 can only imagine what Watson’s words to his cat must have been when he reached this point in 
his work. Perhaps, maybe, they were something like this: “By Jove, Lord Fluffy, I’ve done it! 


Cracked the damn thing wide-open, just like when that egg-head Humpty-Dumpty fell off his 
bloody wall!” 
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The first (t) integral is, from (2.3.4), equal to wa. while the 0 and yw integrals are, 


2(1 
from (4.2.14), each equal to a) Thus, remembering the x normalizing factor, 


1 =) Fi) a) 


we have 


and so 


Z dudvd i 
sealed udav aw ne) 


1 — cos(u)cos(v) cos(w) = 43 


(6.5.1) 


This answer is given in van Peype’s paper, without derivation. 
If we attempt (as we did earlier with the Hardy-Schuster optical integral) to 
check (6.5.1) with MATLAB’s Symbolic Toolbox, by writing 


syms UV W 
int(int(intU/(1—cos(u)*cos(v)*cos(w)),w,0,pi),v,0,pi),u,0,pd/(pir3) 


then we encounter—failure! MATLAB simply goes into an endless loop. But all is 
not lost, as we can use MATLAB’s numerical quadrature command triplequad. 
It does for triple integrals what guad does for one-dimensional integrals (there is 
dbiquad, too, for double integrals, which works the same way as triplequad). For 
our problem, here, the syntax is: 


integrnd = @(u,v,w) 1./(1—cos(u).*cos(v).*cos(w)); 
triplequad(integrnd, 0.001, pi, 0.001, pi, 0.001, pi)/(pi*3) 
which produces the answer: 1.3879. . ., in fairly good agreement with the theoretical 


result I gave you earlier for I,. (Notice that the integration limits start at just a little 
greater than zero, since when u= v= w = 0 the integrand blows-up.) 


6.6 Elliptic Integrals in a Physical Problem 


To finish this chapter, Ill elaborate just a bit on the topic of elliptic integrals, which 
were mentioned in passing in the previous section (see note 6 again). Specifically, 


b dp 
(6.6.1) a I 1—k’ sin2(q’) 
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Fig. 6.6.1 The falling rope 


and 


(6.6.2) E(k, ) = ir 1—k’sin?(p) dp 


0 


are the elliptic integrals of the first and second kind, respectively, where 0<k< 1 
(the constant k is called the modulus). When <4 the integrals are called 
incomplete, while when ¢ = 5 the integrals are called complete. Except for the 
two special cases of k= 0 and k = 1, F(k, #) and E(k, #) are not expressible in terms 
of any of the elementary functions we typically use (trigonometric, exponential, 
algebraic, and so on). 

You might think it would require a complicated physical situation for either F 
or E to make an appearance, but that’s not so. What I'll show you now is a 
seemingly simple physical problem that will nonetheless involve elliptic integrals 
(both E and F, in fact). Making the problem even more interesting is that it has 
appeared in textbooks for well over a century, but until 1989 was routinely analyzed 
incorrectly.” 

Figure 6.6.1 shows a perfectly flexible, inextensible (that is, there is no 
stretching as in a bungee cord) rope with a constant mass density of p per unit 
length. The rope has length L, with one end (the left end) permanently attached to a 
ceiling. The other end is temporarily held at the ceiling, too, until at time t= 0 that 
end is released. The released portion of the rope then, of course, begins to fall (the 
figure shows the situation after the falling end has descended a distance of x) until, 
at time t= T, the rope is hanging straight down. Our question is simple: what is T? 

The one assumption we’!] make in answering this question is that the falling rope 
conserves energy, which means there are no energy dissipation mechanisms in play 
(such as internal frictional heating losses in the rope caused by flexing at the bottom 
of the bend). At all times the sum of the rope’s potential and kinetic energies will be 


° See M. G. Calkin and R. H. March, “The Dynamics of a Falling Chain. I,” American Journal 
of Physics, February 1989, pp. 154-157. 


214 6 Seven Not-So-Easy Integrals 


a constant. When we get done with our analysis we’ll find that the result for T has a 
very surprising aspect to it. 

The center of mass of the left-hand-side of the rope is } (“4*) = '* below the 
ceiling, while the center of mass of the right-hand-side of the rope is 
x+4(52) = Lt 3x below the ceiling. So, taking the zero of potential energy 
(P.E.) at the ceiling, the P.E. of the rope when the released end of the rope has 
descended by x is given by (where g is the acceleration of gravity) 


rem yea ba )ee 


which reduces (after just a little easy algebra) to 


1 
(6.6.3) P.E. = —7hg [L? + 2xL — x’]. 


The kinetic energy (K.E.) of the rope is the K.E. of the descending right-hand- 
side of the rope, which is the only portion of the rope that is moving. Since 


L-x 2 


d 1 
the K.E. of a mass m = n(4) moving at speed v = = is Pa , we have the 


K.E. of the rope as 


(6.6.4) KE. ==p(L — x) (=) : 


From (6.6.3), the initial (when x = 0) P.E. is -} peL?. Also, since the rope starts 
its fall from rest, the initial K.E. is zero. Thus, the total initial energy of the rope is 
-j ugL? and by conservation of energy this is the total energy of the rope for all 
t>0. So, 


1 dy ey " 24 
p(L — x) qhelL + 2xL — x*] = quel 


which reduces to 


2 
(6.6.5) lL 0(5) = F2(2L X)X. 


Notice that has canceled away, and so our analysis holds for any rope with 
arbitrary (constant) mass density. 
Solving (6.6.5) for the differential dt, we have 
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or, 


L-x 

6.6.6 dt = ,/———_. 

(6.6.6) vg GL —x)x 

If we integrate both sides of (6.6.6), where time runs from 0 to t and the descent 

distance of the falling end of the rope varies from 0 to x, we have (I’ve changed the 

dummy variables of integration from t to t’ and from x to x’ so that we can keep t and 
x as our final variables) then 


. L-x’ ' 
dx =t/g. 
(2L — x’)x’ . v8 


(6.6.7) h Vedt = | 


0 


Now, x varies from 0 (at t=0) to L (at t=T). So, if we define the variable ¢ as 


then ¢# varies from 0 to 5. Since x = L sin?((p), let’s now change variable in (6.6.7) 
to x‘=L sin*(’) and so 


dx . ' ' 
an 2L sin (v) cos (0) 
or, 
dx’ = 2L sin (”) cos (Jag. 
Also, with just a bit of easy algebra you should be able to show that 


L-* . cos (p) 
(2L — x’)x’ VLsin () \/1+ cos?(p) 


Thus, (6.6.7) becomes 


| cos () 
0 /Lsin (p')\/1 + cos?(¢’) 


2L sin (0) cos (*) dey 
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or, with a bit of cancelling and rearranging, 


IL 
g 


and so, finally, since t=T when d = > 


(6.6.8) a a HO) gal 


“Why the curious form of the left-hand-side of (6.6.8)?’, you are no doubt 
wondering. To see the why of it, suppose you drop a point mass at time t=0, 
starting from x = 0. How long does it take for that point mass to fall distance L? 
From freshman physics we know the mass will fall distance 5 gt? in time t and so 


sgt? =Lor,t= re which is the curious denominator on the left in (6.6.8). 


Thus, if T > 7 , that is, if the rope fall takes longer than the free-fall time of 


the point mass, then the right-hand-side of (6.6.8) will be greater than 1, but if 
the rope falls faster than does the point mass then the right-hand-side of (6.6.8) 
will be /ess than 1. Finally, if the rope falls with the acceleration of gravity 
(as does the point mass) then the right-hand-side of (6.6.8) will be exactly 1. So, 
which is it? 

This is an easy question for MATLAB to answer for us, and in fact the rope falls 
faster(!) than does the point mass because sgrt(2)*quad(@(x)(cos(x).42)./sqrt(1 
+cos(x).2)),0,pi/2) = 0.847213... . This is not an insignificant deviation from 
1 (that is, it isn’t round-off error), and the rope falls more than 15 % faster than does 
the point mass. Are you surprised? If not, why not? After all, as I mentioned the 
point mass falls with the acceleration of gravity and so, for the rope to beat the point 
mass, it must fall ‘faster than gravity!” How can that be?'° 


'0 The reason is that the falling part of the rope does so under the influence of not just gravity alone, 
but also from the non-zero tension in it that joins with gravity in pulling the rope down. To pursue 
this point here would take us too far away from the theme of the book but, if interested, it’s all 
worked out in the paper cited in note 9. The ‘faster than gravity’ prediction was experimentally 
confirmed, indirectly, in note 9 via tension measurements made during actual falls. In 1997 direct 
photographic evidence was published, and today you can find YouTube videos on the Web clearly 
showing ‘faster than gravity’ falls. 
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At this point an engineer or physicist would probably (after shaking their head in 
amused surprise) start searching for the physical reason behind this curious result. 
A mathematician,'' however, would more likely first wonder just what nice 
mathematical expression is that curious number 0.847213... equal to? The answer 
is, as you might expect from the title of this section, elliptic integrals. Here’s why. 

Starting with just the integral on the right-hand-side of the equation just before 


(6.6.8)—we’ ll put the \/2 factor in at the end—we have 


[ cos?(q ) ay =| 1—sin?() ay =| 1 ' 


0 1+ cos?(q’) 0 2—sin2( ) 


and so, recalling (6.6.1), 
> cos?(p) x 4 ( 1 ) 17° sin?( ) i 
dp = F 0) dp. 
I 1+ cos?() v2 \v2 val 1-4 sin2(4) 
(6.6.9) 


Now, concentrate on the integral on the right-hand-side of (6.6.9). 


'| Mathematicians are just as interested in this problem, and in related problems, as are 
physicists. Indeed, the study of falling ropes and chains was initiated by the British mathe- 
matician Arthur Cayley (1821-1895): see his note “On a Class of Dynamical Problems,” 
Proceedings of the Royal Society of London 1857, pp. 506-511, that opens with the words 
“There are a class of dynamical problems which, so far as I am aware, have not been 
considered in a general manner.” That’s certainly not the case today, with Cayley’s problem 
in particular still causing debate over when energy is (and isn’t) conserved: see Chun Wa 
Wong and Kosuke Yasui, “Falling Chains,” American Journal of Physics, June 2006, pp. 490— 
496. Take a look, too, at Challenge Problem 6.4. 
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pe pe 4 
1— 5 sin“( 


= [ i’ -5 sin? (dp) [; 2 
2 


Thus, using (6.6.2), and (6.6.1) again, we have 


> sin?(q’) (J ) (J ) 3 sin?(#) 
SF — dp = El = 6) - Fl.) + do 
| \/1 4 sin2(q’) v2 v2 al 1 —4 sin2(q) 


or, 


if? in?(p 1 1 
sl eas) a) 
0 1— : sin ( ) 2 2 
That is, we have the interesting identity 


(6.6.10) fw = (4 ») 22(J ») io <=. 
0 \/1—1sin2(9’) v2 va0P ~*~ 2 


Using (6.6.10) in (6.6.9), we have 


rere rials Col) 


sleds) 
“(Ap o9) (9) 
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and so we have a second interesting identity 
(> I Lael 
| soo) ag = ve 1) - GF (Fp) 0<0< 
0 4/14 cos?(p) v2 v2 
(6.6.11) 


Putting this result into (6.6.8), and including the V2 factor in front of the integral, 
we arrive at (for d = 5), 


(6.6.12) fate) F(F5): 


Does (6.6.12) explain MATLAB’s result of 0.847213... ? Yes, because a quick 
look in math tables for the values of the complete elliptic integrals of the first and 
second kind tells us that 


1a 
F( —,-] = 1.8540746... 
(] 5) 


and 


1 
E| —,=] = 1.3506438.... 
(| 5) 


The right-hand-side of (6.6.12) is thus numerically equal to 


2(1.3506438 ...) — (1.8540746...) = 0.847213... 


and so (6.6.12) and MATLAB are in excellent agreement. 


6.7 Challenge Problems 


To end this chapter on tough integrals, it seems appropriate to challenge you with 
some tough integrals. 


(C6.1): Look back at Sect. 6.3, where we evaluated what I called Coxeter’s integral. 
But that wasn’t the only Coxeter integral. Coxeter was actually (as you'll recall 
from the Preface) stumped by a number of integrals, all of which Hardy solved. So, 
here’s another one of Coxeter’s original integrals for you to try your hand at: 
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a /2 1 
| cos! 4 ——_—___ } dx 
0 1 + 2cos (x) 


When this is given to MATLAB we get quad(@(x)acos(1./(1+2*cos(x))),0,pi/2) = 
1.64493... which ought to suggest to you (after reading Sect. 5.3) that the exact 
value is Euler’s €(2) = = Your challenge here is to prove that this is indeed so. 
Hint: this actually isn’t all that tough—at least it shouldn’t be after reading 
Sect. 6.3—and the integral will yield using the same approach we used in the text. 


(C6.2): When we get to Chap. 8 on contour integration we'll do the integral 
‘Oo m 

| ry iis where (to insure the integral exists) m and n are non-negative 
0 xX 


integers such that n— m > 2. For the special case of m= 1—see (8.7.8)—the result 


S | . dx = #f = ,n > 3. If we evaluate the right-hand-side for the first 
0 xo -- 1 sin (#) 


few values of permissible n, we get 


n Value of integral 
3 1.2091995 
4 0.7853981 
5 0.6606532 
6 0.6045997 
7 0.5740354 
. . 2 dx 
Now, consider the integral ,n > 3. If we use 
o xml xmr24...+x+1 


MATLAB’s quad to numerically evaluate this integral for the same values of n 
we get 


n Value of integral 
3 1.2091992 
4 0.7853988 
5 0.6606537 
6 0.6046002 
7 0.5740356 


These numerical results strongly suggest that the two integrals might be equal. 
You could study this question directly, by ‘simply’ evaluating the second integral 
(but that might not be so ‘simple’!). Another possibility is to first write the 
difference of the two integrands f(x) = ae se =} a and then (somehow) 


show that J o°f(x)dx =0. See if you can do this. 


(C6.3): Here’s a problem reminiscent of the ‘sophomore’s dream’ of (6.1.4). There 
is a value of c with 0<c< 1 such that [ jc dx =) ie Calculate the value of c 
accurate to at least 13 decimal places and, for that value, what is the common value 
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of the integral and the sum? Hint: to start, observe that since c is between 0 and 
1 there must be some 4 >0 such that c=e~*. (A=0 gives c= 1, and \=00 gives 
c=0.) This notational trick makes both the integral and the sum easy to evaluate. 
Then, equate your expressions for the integral and the sum to get a transcendental 
equation for A, an equation that can be solved numerically using any number of 
well-known algorithms (my suggestion: see any book on numerical analysis and 
look for a discussion of the binary chop algorithm) to give c to the required 
accuracy. 


(C6.4): I mentioned ‘Cayley’s Problem’ in the text, but didn’t provide any details. It 
is the problem of computing how a uniform mass density (1) linked-chain, initially 
heaped-up near the edge of a table, falls from the table as it slides without friction 
over the edge. If x is the length of the chain hanging over the edge at time t, then the 
problem is to find the differential equation of motion (involving x and t) and then to 
solve (that is, integrate) it for x as a function of t. In his 1943 book Mechanics, the 
German physicist Arnold Sommerfeld (1868-1951) stated without derivation that 


the equation of motion is (where g is the acceleration of gravity) 


4 (xk) = xX + X? = gx. In this dot notation (due to Newton) x = ® and X = o. 


In Leibnitz’s more suggestive differential notation, Sommerfeld’s equation of 


motion is a (x ax) = xy + ey = gx, and of it he said “its integration is some- 
what difficult.” A very clever derivation of Sommerfeld’s equation can be found in 
the paper by David Keiffer, “The Falling Chain and Energy Loss,” American 
Journal of Physics, March 2001, pp. 385-386. Keiffer made no reference to 
Sommerfeld, but rather based his derivation on a direct analysis of how a chain 
slides off a table, link-by-link. Keiffer gave an interesting twist to problem by 
converting it to determining the speed of the falling chain as a function not of 
time, but rather as a function of the length of chain that has already slid off the table 


(that is, of x). Calling the speed v(x), his equation of motion is lta = 2 v? + 2g. 


(a) Show that Keiffer’s equation and Sommerfeld’s equation are one-in-the-same; 

(b) Noticing that Keiffer’s equation is a first-order differential equation in v7, use 
the same approach we used in Chap. 3 (Sect. 3.9) to integrate Keiffer’s equation 
to find v*. Hint: consider using x’ as the integrating factor; 

(c) Show that the chain falls with the constant acceleration ; g (this was Cayley’s 
central result); 

(d) Use your result from (b) to calculate T, the time for a chain of length L to 
completely slide off the table. 

Now, in the interest of honesty, I have to tell you that while all your 
calculations in response to the above questions represent good, solid math, 
there has been much debate in recent years on whether or not it is good physics! 
The Cayley, Sommerfeld, Keiffer analyses involve a failure of energy conser- 
vation when a chain slides off a table. This is actually quite easy to show. The 
chain’s initial P.E. and K.E. are both zero (the table top is our zero reference 
level for P.E., and the chain is initially at rest), and so the initial total energy is 
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zero. When the chain has just finished sliding completely off the table, its speed 
is /784, a result you should have already come across in your earlier analyses. 


2. 
So, its K.E. is }(pL) * = » 4. The chain’s center of mass is at § below the 


table top, and so its P.E. is —pLg$ =U Le Thus, at the completion of the fall 
its total energy is yu Ee —yU < 0. Thus, energy was lost during the fall. (This 
is a puzzle in its own right, since the slide was said to be frictionless. So, how is 
energy dissipated? This was, in fact, the question that stimulated Keiffer to 
write his paper in the first place.) In recent years, other physicists have claimed 
that Cayley’s falling chain does conserve energy. So, for your last question 
here, 

(e) Assuming conservation of energy, show that the chain falls with the constant 


acceleration of 5 g (not Cayley’s i g). 


(C6.5): This problem involves a very different appearance of integrals in 
yet another physics problem. (See James M. Supplee and Frank W. Schmidt, 
“Brachistochrone in a Central Force Field,” American Journal of Physics, May 
1991, pp. 402 and 467.) Imagine a tiny bead of mass m with a wire threaded through 
a hole in it, allowing the bead to slide without friction along the wire. The wire lies 
entirely in a horizontal plane, with one end (in terms of the polar coordinates r and 
0) at (R, 2) and the other end on the horizontal axis at (R, 0). The only force acting 
on the bead is the inverse-square gravitational force due to a point mass M located 
at the origin. That is, the bead slides on the wire because it experiences the 
attractive radial force F = GM, where G is the universal gravitational constant. 


The bead has initial speed , /2 GM What shape function r(0) should the wire have to 


minimize the travel time of the bead as it slides from (R, 0) to (R, ")? To answer this 
question, fill-in the details of the following steps. 


(a) Show that the initial potential energy (P.E.) of the bead is — SM@™, and that the 
p gy 


R 
initial kinetic energy (K.E.) of the bead is Ghm, and so the total initial energy is 
zero. Hint: the initial P.E. is the energy required to transport the mass m in from 
infinity along the positive horizontal axis to r=R, which is given by JRF dr. 
This energy is negative because gravity is attractive; 


(b) If T is the total time for the bead to travel from one end to the other, then T 


= fac = |e where v is the instantaneous speed of the bead and ds is the 


differential path length along the wire. In_ polar coordinates 


(ds)? = (dr)* + (rd0)* and thus ds = d0\/ (sy? +12. Invoking conservation of 
energy (K.E. + P.E. = 0, always, because there is no friction), show that 


3 dr\2 
Seen 3dQ: 
T= ail, (35) + rd0; 
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(c) To minimize T is a problem beyond ordinary freshman differential calculus, 
where we try to find the value of a variable that gives the extrema of some 
function. Our problem here is to find a function that minimizes the integral for 
T. This is a problem in what is called the calculus of variations, and a 
fundamental result from that subject is the Euler-Lagrange equation: if we 


write the integrand of the T-integral as K = rr? +13, where r = sr. then 
ck = 4 (5) = 0. This result is derived in any book on the calculus of varia- 


tions (or see my book When Least Is Best, Princeton 2004, 2007, pp. 233-238). 
Euler knew it by 1736, but the derivation I give in WLIB is the now standard 
one developed by the French-Italian mathematical physicist Joseph Louise 
Lagrange (1736-1813), in a letter the then teenage (!) Lagrange wrote to 
Euler in 1755. Use the Euler-Lagrange equation to show that the required r(0) 


° . . * 2 
satisfies the differential equation 51’? + 31? = 2r'r’, where r’ = os 


(d) Change variable tou = r, and show that the differential equation in (c) becomes 
wt+l= zu, where u = ay. Hint: Start by writing the differential equation in 
(c) as 


12 a. 12 
3r +3r? =2rr —2r ; 


(e) The differential equation in (d) is 3 dé = iit which you should be able to easily 
integrate indefinitely to show that u = tan (30 +C,), where C, is an arbitrary 
constant; 

(f) The result in (e) says : ar = tan (30 +C,), which you should be able to 


integrate indefinitely to show that r = C cos ~2/3 (30 +C)); 
(g) Use the coordinates of the ends of the wire to evaluate the constants C, and C3, 


thus arriving atr(0) = Fr cst (OH a curve called a brachistochrone, from the 


Greek brachistos (shortest) and chronos (time). Note, carefully, that it is not the 
shortest /ength curve, which of course would be a straight line segment. 


Chapter 7 
Using /—1 to Evaluate Integrals 


7.1 Euler’s Formula 


The use of i = \/—1 to compute integrals is nicely illustrated with a quick example. 
Let’s use i to do 


[" dx 
1 x(x? + 1) 


Making a partial fraction expansion of the integrand, we can write 


le dx =|")! i 1 |, 
Cau) 1 )x 2%x-d) 2x+d x 


= {ints +n() +n(ae) ir 
= in eel = nf a} Se ns) 
= in(,/2) = sin(2) = 0.34657... 


Checking with quad, quad(@(x)1./(x.*(x.42 + 1)),1,1000) = 0.34657... . 

This is nice, yes, but the utility of complex-valued quantities in doing definite 
integrals will really become clear when we get to the next chapter, on contour 
integration. The value of the complex can be immediately appreciated at a ‘lower’ 
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level, however, without having to wait for contour integrals, and all we’ll really 
need to get started is Euler’s famous identity: 


(7.1.1) e”* — cos (bx) + isin (bx), 


where b is any real quantity. I'll take (7.1.1) as known to you, but if you want to 
explore it further, both mathematically and historically, you can find more in two of 
my earlier books.' 

A very straightforward and yet still quite interesting demonstration of Euler’s 
identity can be found in the problem of calculating 


| sin (bx)e~*” dx. 
0 


This is usually done by-parts in freshman calculus, but using —1 is easier. 
Since 


e * — cos (bx) — isin (bx) 


it then follows that 
elbx _ e7ibx 
pes 
sin (bx) 


Thus, 


e7X(y—ib) = e7X(y+ib) 


e *’ sin (bx) = oF 
i 


and so 


i 1/*° 
| e *Y sin (bx)dx = | em — eo *(ytib) hax 
0 


r ~ i 
came ae | 1 
o 2ily-ib y+tib 


1 ea X(y-ib) e 7 x(y+ib) 
=7 (y — ib) —a} 


lfy+ib—y+ib) 2b 
Zit y*+b 2i(y? + b’) 


"An Imaginary Tale: the story of /—1, and Dr. Euler’s Fabulous Formula: cures many mathe- 
matical ills, both published by Princeton University Press (both in multiple editions). 
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and so 


co , a b 
(7.1.2) J, sin(bx)e"*¥ dx = a 


7.2 The Fresnel Integrals 


Well, that last calculation was certainly interesting but, to really demonstrate to 
you the power of Euler’s identity, 11 now show you how to use it to derive two 
famous definite integrals named after the French scientist Augustin Jean Fresnel 
(1788-1827). There is just a bit of irony in the fact that, despite the name, it was 
actually Euler who first found the values (in 1781) of—before Fresnel was even 
born!—the ‘Fresnel’ integrals, 


10.0) 


| cos (x’)dx and | sin (x*) dx, 
0 0 


using a different approach from what I’m going to show you.” (We used the value of 
the second integral in Sect. 6.4, in the discussion of the Hardy-Schuster optical 


integral.) 
x 2 1 ix? (P41) 
| eat} + a 
0 9 t+l 


We start with 
(Pll explain where this rather curious G(x) comes from in just a moment.) 
Notice, in passing, that 


1 


G(0) = 0+ | =i fn (1) =i, 


ot+l1 


which will be important for us to know a few steps from now. Differentiating G 
(x) with respect to x, 


dG x r 1 i2x(t2 6 Le (PH) 
a ot it” 1Xe . 
a = 24 | e ake + i[ Pai dt 


% 1 x 1 
ae oe, Sette te ee 3 42, ay 2 im Pv} 
= 2e”* | e dt — 2x| e* Fe dt = 2e* | e” dt — 2xe” | edt. 
0 0 0 0 


? Euler used the gamma function (another of his creations that you'll recall from Chap. 4) in his 
1781 analysis, and you can see how he did the Fresnel integrals in An Imaginary Tale, 
pp. 175-180. As you’d expect from Euler, it’s breathtakingly clever. 
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In the last integral change variable to u=tx (and so du=x dt or, dt = du/x). 
Then, 


d 7 Re os ; Cameras | ; came mee 
ag = 22" edt — 2xe™ | gn SEs Jel” | eM at — | eau] =0. 
dx 0 0 x 0 0 


That is, G(x) has zero rate of change with respect to x, for a// x. G(x) is therefore 
a constant and, since G(O) = a that’s the constant. This result explains the origin of 


the remarkably ‘strange’ G(x); it was specially created to have the property of a 
zero-everywhere derivative! 
Now, as x — 00, we have 


f ix? (?+1) 


a claim that I'll justify at the end of this section (but see if you can do it for 
yourself before I get to the end of the section). For now, just accept it. Then, 


on {f'ea}'-| 


Let’s write this as 


10.6) 


i COs (t”) dt + | sin ejach 


0 0 


G(oo) = (A + iB)* 


where A and B are the Fresnel integrals: 
A= | cos (t°)dt and B= | sin (t?) dt. 
0 0 
Then, since G(oo) = ij (remember, G(x) doesn’t change as x changes and so G 
(co) = G(O)) we have 


(A + iB)? = i= = A? +i2AB — B? 


T 
4 
and so, equating real and imaginary parts on both sides of the last equality, we have 
A* — B*=0 (which means A = B) and 2AB = %. So, 2A” = “and, suddenly, we are 
done: A= \/§ = 5y/5 = 0.6266.... and (because A=B) we have the Fresnel 
integrals: 
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(7.2.1) if, cosG dx = ap 
and 
(7.2.2) f, sin(x?)dx = a : 


Checking, quad(@(x)sin(x.42),0,30) = 0.6255. . . and quad(@(x)cos(x.42),0,35) = 
0.6235. .., both suggestively close to },/3. And since 


| e™ dx = | cos (x°) dx + | sin (x’) dx 
0 0 0 


we have the interesting integral 


G2) 28) es 1 T » 
(7.2.3) f, e* dx ==> |, +i). 
To finish this discussion, I really should justify my earlier claim that 


1 ix?(?-+1) 
li [: dt = 0. 


9 t+ 


xX—00 


To show this, use Euler’s identity to write 


i el cos {x2(t? + Vasil sin {x2(t? + ee 


9 +1 0 e+ 0 e+ 
Since 
cos {x?(t? + 1)} = cos (x*t? + x”) = cos (x’t) cos (x”) — sin (x’t’) sin (x”) 
and 


sin ix (? + 1)} = sin (x? + -) = sin Ger} cos () + cos er | sin (a), 


and because as x — oo the factors cos(x’) and sin(x*) remain confined to + 1, our 
claim will be established if we can show that 


230 7 Using V—1 to Evaluate Integrals 


__ [i sin {xt} ; 
lim a a ee = lim 
0 t +1 X00 


D Canq er) } 
ae |e tno 


Consider the first integral, and make the change of variable u=t?. Then du = 2t 


=1 = _ 1 
and so dt = ;-du or, as t = y/u, we have dt = aad. So, 


[ sn ha =f af ( 1 ) au if sin {x’u} 


09 C+ 9 utl \2Vu 9) ee ihya 


! sin {x’u} 
< | ————du, 
i vu ‘i 


where the inequality follows both from dropping the 5 factor and replacing the 
denominator in the integrand with a smaller quantity. Notice that the integrand of 
the right-most integral is an amplitude-damped sinusoid, with each new half-cycle 
bounding ever-less area (with alternating signs). The areas of the half-cycles form 
the terms of a monotonically decreasing alternating series, and the total area of the 
half-cycles is the value of the integral. 

Now, recall a beautiful result from numerical analysis that says any partial sum 
of such a series, with more than one term, is less than the first term. Since the zeros 
of sin{ xu} occur at x*u = nz, then the first two zeros in the integration interval (the 
start and end of the first half-cycle) are at u=0 and u = 3, respectively, and so 
replacing sin{x*u} with its greatest value of 1, we have the even stronger inequality 


2 


ih SET ee ie =A =2(va)* = 


9 ttl 0 u 0 Xx 
and so, since any partial sum of our alternating series is clearly never negative, we have 


' sin {x?t? 2 
tim | cae i 
o t +1 x00 X 


=0. 


X—0O 


A trivial modification in the above argument shows that 


as well. 


>You can find the proof of this (which requires only elementary algebra) in just about any 
freshman calculus textbook. Look in the index under the ‘conditional convergence of alternating 
series,’ or something along those lines. In my old copy of Thomas’ Calculus and Analytic 
Geometry, for example, that I mentioned back in the Introduction (Chap. 1, Sect. 1.4), it’s on 
pp. 614-615. 
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7.3 ¢(3) and More Log-Sine Integrals 


You'll recall, from Chap. 5 (Sect. 5.3), Euler’s fascination with the zeta function 


co 1 
C(s) = ae Ee: He found explicit formulas for C(s) for any positive even integer 


value of s but he couldn’t do the same for the odd values of s, even though he 
devoted enormous time and energy to the search. In 1772 he came as close as he 
ever would when he stated 


n/2 2 
| xIn{ sin (x) }dx = 5603) = = in(2). 


0 


The key to understanding how such an incredible result could be discovered, as 
you might expect from the earlier sections of this chapter, is Euler’s identity. Here’s 
how it goes. 

Define the function S(y) as 


S(y) =1+e%+e7% 4+ eP74...4 em 
where m is some finite integer. This looks like a geometric series and so, using the 
standard trick for summing such series, multiply through by the common factor e’ 
that connects any two adjacent terms. Then, 
e¥S(y) = ely of ey hs ey ise oe eimy fe el(m+Dy 
and so 


e"S(y) = S(y) = ft = 1. 


Solving for S(y), 


sty) ellm+Dy _ 1 ellm+Dy _ 1 el(my)y _ 3 
om = e2(e2 —e%)  —s i2sin (3) 


) 
_ cos {(m + 4)y} + isin {(m+4)y} — cos (3) + isin () 


aa 


Now, looking back at the original definition of S(y), we see that it can also be 
written as 


=1 +e" cos (ny) +iyo sin (ny). 


So, equating the imaginary parts of our two alternative expressions for S(y), we 
have 
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cos{(m+s)y } , cos (3) = 37", sin (ny). 


a(x (ye 
2 sin (3) 2 sin (3) 
At this point it is convenient to change variable to y = 2t, and so 


cos {(2m + 1)t } 
sin (t) 


+ cot ( O22). sin (2nt). 


Then, integrate this expression, term-by-term, from t= x to t=}, getting 


2 2 1)t 
pas OT ed + | cott jdt = 250" _ [sin can (2nt)dt. 


7 sin (t) 


The integral on the right of the equality sign is easy to do: 


f qe le cos (2nt) } |? _ = 00s (na) + cos (2nx) 
a 2n x 2n 

__ cos (2nx) — (—1)" 

7 2n , 


The last integral on the left of the equality sign is just as easy: 


fd 


[ cot (t)dt = [In{ sin (t) }] |? = In{ sin 6) } — In{ sin (x)} = —In{ sin (x)}. 


Thus, 


| een Infsin(x)} = ym em m_ (-1)" 


sin(t) n=17 4 


You'll recall that at the start of Sect. 5.2 we had the power series 
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So, if we let m — oo in the above boxed equation we have 


lim. = oom De a ntentey= be ae nx) + In(2). 


Since the limit of the integral at the far left is zero,’ we arrive at 


oo cos (2nx) 


In{ sin (x)} = ae 


The next step (one not particularly obvious!) is to first multiply through by x and 
then integrate from 0 to m: That is, to write 


In(2). 


n 


a4 
2 


[xing sin (x) }dx = -\S~* Pxcos( cos (2nx)dx — in(2)| x dx 


0 


wih 


2 


-S**, =| 00s ( cos (2nx)dx — = In(2). 


I 


To do the integral on the right, use integration by parts, with u=x and dv=cos 
(2nx)dx. By this time in the book you should find this to be old hat, and so I'll let 
you fill-in the details to show that 


— 4, if n is odd 


— 2 
X COS (2nx)dx “— 0, if nis even‘ 


oO Nis 


Thus, 


2 : 1 oo 1 a 
[xing sin (x) }dx = AD 24 =} gin). 
We are now almost done. All that’s left to do is to note that 


ae Ee a, pee te 
ntneven nS — 37 ge BT (2.43 | (2-2) | (2-3)3 


i7i of 4 fae 1 1 
=|) +s Se — = ~¢(3). 
“(2 tat 33 = ) 3D ane n3 go ) 


* This assertion follows from the almost intuitively obvious Riemann-Lebesgue lemma, which says 
that if f(t) is apscneey integrable over the interval a to b, then lim, _. x J °f(t)cos(mt) dt=0. In 


our case, f(t) = which is absolutely integrable over 0 < x < t < 5 since over that interval If 


sin mo 
(t)l < oo. You can find a proof of the lemma (it’s not difficult) in Georgi P. Tolstov’s book Fourier 
Series (translated from the Russian by Richard A. Silverman), Dover 1976, pp. 70-71. 
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And so, since 


Deke odd n? + ae even nd = ¢(3) 


we have 


So asge = 52) — Sm even gi = EE) ~ gE) = ZO). 


n=1,n even n? 


Thus, just as Euler declared, 


(7.3.1) {o"? x Infsin@x)}dx = 2 ¢(3) — = In(2). 


The right-hand-side of (7.3.1) is (5) (1.20205 a © In(2) = —0.32923..., 
while the integral on the left is equal to guad(@(x)x.*log(sin(x)),0,pi/2) = 
— 0.32923.... 

As I mentioned in Chap. 2 (Sect. 2.4), years ago it was often claimed in 
textbooks that Euler’s log-sine integral was best left to the massive power of 
contour integration. Yet, as you’ve seen in this book, classical techniques do 
quite well. I'll now show you that even if we ‘up-the-anty,’ to log-sine integrals 
with a squared integrand, we can still do a lot. Specifically, let 


/2 /2 
I = | In’{a sin (0)}d0 = | In?{acos (8) }d0 
0 0 


and 
n/2 
I, = | In{a sin (8) Hn{a cos (6) }d6 


where a is a positive constant. These integrals were not evaluated by Euler, but 
rather are due to the now nearly forgotten English mathematician Joseph 
Wolstenholme (1829-1891). Here’s how to do them. 


m/2 
| [In{a sin (8)} + In{acos (0) }]7d0 


m/2 
= | In? {a’ sin (8) cos (8) } dO 
0 

m/2 


/2 
= | In*{a sin (0)}d0 + | In?{acos (0) }d0 
0 0 


/2 
+ 2| In{a sin (8) Hn{acos (6) }d0 = 21, + 2h. 
0 
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But since 


ig In? {a’ sin (8) cos (8) } dd = [ inf? sn 


0 


/2 : /2 2 
21, + 2h = | ine a? ao = | ina sin (20)} — inf} do 
0 2 0 a 
m/2 0] /2 2 a /2 
= | In*{a sin (20) } do — 2n{ 2h In{a sin (20) }d0 + nef = | dé. 
0 0 0 


Write ) = 20. So, as dO = 5dip, we have 


m/2 


a /2 5 1f7 ‘ 5 
| In* {a sin (20)} dd = 5| In‘ {asin ()} db = | In“ {asin (b)} db = I, 


0 0 0 


and, by (2.4.1), 


m/2 


[ In{a sin (20) }d0 = an Inf{a sin (p) }do = | 


0 


Infasin () }d = In () 


Thus, 


2, +2b =1, —21 -\Ein(S) + Sintf= 
Ld al a Oh 2 La 


or, 


2|", (a, 4%, 4 f2 
I, +2h = 2in{ 2 Sn(3) Fin {(Z. 


Also, 


m/2 
| [In{a sin (8)} — In{acos (6) }]7d0 


n/2 /2. 5 
= | In? {a sin (0)}d0 + | In? {a cos (8) }d0 — 2] Infa sin (8) }n{acos (6) }d0 
aye asin (8) nie nm 
= 21, — 2, = | inf oie = ih In*{ tan (0)}d0 = Fy 


by (5.2.7). So, we have the simultaneous pair of equations 
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which are easily solved to give 


/2 Tt/2 
i In? {a sin(6)}d0 = | In? {a cos(6)}d0 
0 0 


(7.3.2) 
rate lean }mGQ)| 
Raceline etal Qa) 
and 
1/2 ; ants 2 2 a ce 
(7.3.3) J, In {a sin(®)}In{a cos(0)}d@ = - [in? 7} — 2In {7} In @)| ore 
For example, if a=2 this is equal to -= =— 0.645964... and MATLAB 
agrees, as 
quad(@(x)log(2*sin(x)).*log(2*cos(x)),0,pi/2) = — 0.645979 ...,. while for 


a= 1 (7.3.3) reduces to 2 In? {2} _ . = 0.108729... and quad(@(x)log(sin(x)). 
*log(cos(x)),0,pi/2) = 0.10873... . 


7.4 (2), At Last! 


A much more impressive demonstration of the use of Euler’s identity is the 
derivation I have long promised you—the value of €(2), first calculated by Euler. 
We’ ve already used this result (©) numerous times, but now I’ll derive it in a way 
you almost surely have not seen before. 

Recall again the power series expansion from Chap. 5 (Sect. 5.2) for In(1 +z): 


2 3 4 


Z Z Z 
In(1-+z) =z— en 
ee eae ak ae 


where now I’m taking z as a complex-valued quantity, and not simply a real 
quantity as I did in Chap. 5 where I wrote x instead of z.° If we write z=e”® 
where a and 6 are real, then 


> How do we know we can do this? This is a non-trivial question, and a mathematician would 
rightfully want to vigorously pursue it. But remember our philosophical approach—we’ll just 
make the assumption that all is okay, see where it takes us, and then check the answers we 
eventually calculate with quad. 


7.4 (2), At Last! 237 


24120 43,130 4,140 
; 4 ae ave a*e 
In(1 + ae!) = ae” — 
( * ) 2, = 3 4 = 


or, expanding each term with Euler’s identity and collecting real and imaginary 
parts together, 


j 1 1 1 
In(1 + ae”) = a cos (0) — 3 cos (20) + i cos (30) — ma cos (48) +... 
a ee Lg 13. 
+i¢ asin (8) — 54 sin (20) + 3° sin (30) —... 


Now, 1 +ae’ = 1+acos(@) +iasin(@) isa complex quantity with magnitude and 
angle in the complex plane (with respect to the positive real axis)° and so we can 
write it as 


1+ ac” = Ju + acos (0) }* + a? sin2(@) e? 


= \/1 + 2acos (8) + a2 cos2(@) + a2 sin2(0) e'? 


= /1+ 2acos (0) + a2 e?. 


Thus, 


In(1 + ae”) = in{ V1 + 2acos (8) + a} + ig 
or, equating real parts, 
1 ; ll 4 is Ls 
sini! + 2a cos (8) + a*} = acos (0) — 5H cos (20) + gt 60s (30) — qe cos (40) +... 
or, 


1 1 1 
In{ 1 + 2a cos (8) + a? } = 2}acos (8) — al cos (28) + a cos (38) — ra cos (40) +...]. 


asin () 
1+acos () 


© The angle is given by @ = tan~! { \. but we’ll never actually need to know this. 
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So, if we write a= — x we have 


1 1 
In{1 — 2xcos (0) + x?} = —2 [ cos (8) + x cos (20) + x cos (30) +.. | 


and so 
2 
In? {1 — 2x cos (8) + x?} =4 c cos (8) + 5x? cos (20) + 4x3 cos (30) + es 
x! xo 
= 4| x? cos?(0) + 52008 ?(20) + gz 008 *(30) + 
plus 


all the cross-product terms of the form cos(m@)cos(n@), m# n. 
Integrals of these cross-product terms are easy to do, since 


{. cos (m8) cos (n6)d6 = | [cos {(m — n)0} + cos {(m + n)0}]d6 
0 0 


These integrals are easy to do because the integral of a cosine with a non-zero 
argument (remember, mn) gives a sine and so, between the given limits, every 


one of the cross-product integrals is zero. So, 


| In? {1 — 2x cos (0) + x” }d0 
0 


r 4 pn 6 
=a[e| cos (0)d0 + 5| cos?(26)d0-+ 75 cos?(30)d0 +... 
0 0 0 


From integral tables we have 


6 sin | he _t 
= 


2 
k@)d0 = |—4 
| corn) 4k 


and so 


T 4 6 
| In?{1— 2x cos (0) + x* } 40 = 4(5) I | > ! 7 | va 


or, 
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if? : we xt x6 
xz, {1 — 2xcos (8) +x pee aa aa 


7 teen 


Since cos(9) varies from +1 to —1 over the interval of integration, we can change 
the sign in the integrand without changing the value of the integral to give 


LL" ne{1 + 2x00s(0) +37} d0= "S444 
On 6 = eZ ye 32 ‘Peete 
Thus, setting x = 1, we have 
| nta+2 (0)} do ee ae oe C(2) 
—| In cos = s4+54+5+...= 
on 0 12 9? 32 


= zl, In? {2 [1 + cos (@)]}d0. 


We are getting close! 

If we can do the integral on the right, we’ll have Euler’s famous result. So, 
continuing, the double-angle formula from trigonometry says cos(2a)= 
2 cos?(«) —1andso 


2 


1 i 0 1 t Q 
(2) = = |In* 2 |2cos” 5 dé = = |In? 2.cos 5 doe 
0 0 


if 0 2I 0 
= 5,40’ 2cos ; ao = 2) uw? 2cos ; do. 
0 0 


Now, let « = Q and so d0= 2 da. Then, 
2 m/2 4 /2 
62) = -| In? {2 cos (a) }2 da = =| In? {2 cos (cr) } da. 
TJo TJo 
From (7.3.2), with a= 2, we see that 
m/ 2 , a 
In“ {2 da = — 
| n° {2 cos (a)} do A 


and so 


ma()Q)=8 


just as Euler showed (in a completely different way). 
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7.5 The Probability Integral Again 


Earlier in the book I’ve shown you how some of our tricks can be combined to 
really bring terrific force to attacking particularly difficult integrals. Here Pll do it 
again, but now we additionally have Euler’s identity to join in the mix. First, let me 
remind you of (3.7.1) where, if we set a= 1 and b=0 we have 


SF 3 1 
(7.5.1) | e *dx= 5Ve 


0 


Now, make the change of variable x = u,/z, where z is a positive quantity. Then 
dx = ,/z du and so 


or 


1 Al = 
Se ede: 
vz V«Jo 


The next step is the central trick: multiply both sides by e”, integrate with 
respect to z from a to b (where b > a > 0), and then reverse the order of integration 
in the resulting double integral on the right. When we do that we arrive at 


[poe feof Bf er} 2 {feta 


The inner integral is easy to do: 


b eb(i-u?) _ ea(i-v’) 


i-w 


a 


Next, imagine that we let b— oo and a— 0. Then the first exponential on the 
right — 0 and the second exponential on the right — 1. That is,’ 


| ART) a = —1 


0 i-w 


and so (remembering that —— 1) we have 


7 Mathematicians will want to check that the limiting operations b—> oo, a— 0, and that the 
reversal of the order of integration in the double integral, are valid, but again remember our 
guiding philosophy in this book: just do it, and check with quad at the end. 
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[ ez ‘i 2 [ 1 4 2 [° —i-w P 
Z= - u= : : u 
0 VE Fily = Valo GCI) 
2 [i+w 
= du. 
“al iu" 


Or, if we use Euler’s identity on the z-integral and equate real and imaginary 
parts, we arrive at the following pair of equations: 


love) ioe) 2 
| cos (z) — =| Wau 
0 vz VaJo 1+ut 


and 


°° sin (z) 2 | ed 
dz = du. 
| 0 vz Varo 1+ut 
We showed earlier, in (2.3.4), that the two u-integrals are each equal to es and 
so we immediately have the beautiful results (where I’ve changed back to x as the 
dummy variable of integration) 


(7.5.2) 


co cos(x) _ po sin(x) _ jf 
d we OX = Jy Dax = fF 


That is, both integrals are numerically equal to 1.253314..., and we check that 
conclusion with quad(@(x)cos(x)./sqgrt(x),0,1000) = 1.279... and quad(@(x)sin 
(x)./sqrt(x),0,1000) = 1.235... . These numerical estimates by quad aren’t as 
good as have been many of the previous checks we’ve done, and that’s because 
the integrands are really not that small even at x = 1000 (,/x is not a fast-growing 
denominator, and the numerators don’t decrease but rather simply oscillate end- 
lessly between + 1). P’ll say more on this issue in Chap. 8. 


7.6 Beyond Dirichlet’s Integral 
Looking back at Dirichlet’s integral that we derived in (3.2.1), 


es as 
0 xX 2 
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it might occur to you to ask what is 


[ey 


equal to? This is easy to answer if you recall (3.4.1): 


dx ==(b ; 
0 x2 x 5 ( a) 


[° cos (ax) — cos (bx) 1 
With a= 0 and b=2 we have 


[° 1 — cos (2x) a 


0 ae 


and since 1 — cos(2x) =2 sin*(x), we immediately have our answer: 


ea (ee 2 
(7.6.1) i {Ro} dx ==. 


This is 1.57079 ..., and MATLAB agrees: guad(@(x)(sin(x)./x).42,0,1000) = 
1.57056... . 
Okay, that wasn’t very difficult, and so the next obvious question is to ask what 


cen 


is equal to? This is just a bit more difficult to answer, but certainly not impossibly 
so. Integrating by parts does the job. Let u=sin*(x) and dv = & and so du = 3sin* 
(x) cos (x) and v = —;4. Thus, 


ie ee) 


oo 3 oe) ame? 
| | sin wes (x) as 
0 2 0 Xx 
3 si 2 
7 | sin~(x) cos (x) ae 
2; 0 x2 
Then, integrate by parts again, with u= sin?(x)cos(x) and dv = x. Then v = —; 


and #4 = 2 sin (x) cos*(x)— sin3(x) = 2sin(x)[1 — sin*(x)]— sin3(x) = 2 sin (x) 
—3 sin 3(x). Thus, 
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3 
°° J sin (x) _3 sin? (x) cos (x) io 
Sein re 


[= (x) — 3 sin3(x) 7 


then 
°° { sin (x) - —4(®\ 97m) _ 12m On 
imi xX \ x=3(5) a) 8 8 
or, 
(7.6.2) lies (ney dx = = 


This is equal to 1.1780972. . ., anda MATLAB check agrees: quad(@(x)(sin(x)./x). 
43,0,1000) = 1.178086... . 


To keep going in this way—what is | {ae} dx, for example?—will soon 


0 Xx 
prove to be onerous. Try it! With a more systematic approach, however, we can 
derive additional intriguing results with (hardly) any pain. We start with Euler’s 
identity, and write 


z=e* = cos (x) +isin(x), i=V-1. 
Then, for any integer m > 0, 


z™ = e'™ = cos (mx) + isin (mx) 


and 
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—m —imx 


—=2z™=e = cos (mx) — isin (mx) 
and so 
1 oe 
z™ — — =i 2sin(mx). 
zm 
In particular, for m= 1 


1 
—-=i12si ; 
aa i 2 sin (x) 


So, 


{i 2sin(x)}7""! = {, : Ve 


or, expanding with the binomial theorem ( where you'll recall the notation 


{i2sin (x)! = So Gs eae) 
Sy Ga 


When the summation index r runs from r=0 to r= 2n— 1, it runs through 2n 
values. Half of those values are r=0 to r=n-— | (for which the exponent on z is 
greater than zero), and the other half (r =n to r= 2n — 1) give the same exponents 
but with negative signs. So, we can write 


{i2sin (x)}2"-! = ae ayy ') [sent o_o 
But 
A ae see — = i2sin{(2n — 2r — 1)x} 
and so 


{i2sin (x)! = 57! os ai sn One eS. 


j20- 192n— I. n2n- TS) 
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2n—1 . -1 8 
Now i” =i(—1)""~ and so 


i(—1)"12°-! sin®“"(x) = So" ayr(7"y : ja dfn ore txt 


T= 


(7.6.3) |sin2"-1(x) = a > (-1)" ‘a *) 2 sin{(2n — 2r — 1)x}. 


Dividing both sides of (7.6.3) by x, and integrating from 0 to oo, we have 


P arte = Soe as ay(7" - er sin {(2n — 2r — 1)x} ee 


0 r 0 x 


In the integral on the right change variable to y = (2n—2r — 1)x and so 


[° stn ax = | ts dy i) = os 


y 
0 = 0 2n—2r—-1 2r 0 ¥ 2 


Thus, 
© Sine ee) ei n-1 ,(2n-1 
| a La -1y( , ), 


We can simplify this by recalling the following combinatorial identity which 
you can confirm by expanding both sides: 


(i) = (aa) + Ca") 


Here’s how this result helps us. Consider the alternating sum 


® To see this, write 2°~! = jj2"-2 if i) rs i( yr. 
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Sane(-O(E) = (5) - (2) + (3) - GQ) +n). 


The first term on the right is 1, and then expanding each of the remaining terms 
with our combinatorial identity, we have 


Ecar()--[C5')S (00) 
(3-05) 
ver[) Cad] 


Since ( ij ' ) = 1, and since the last term in any square bracket cancels the 


first term in the next square bracket, we see that only the last term in the final square 
bracket survives. That is, 


sracm(s)-cor(!) 


Thus, with m=n-— 1,k=r, ands=2n-— 1, we have 


© ein 8-7 (x) (<1 n_-1 / 2n—2 
| .. dx = al n( 1) Gy, 


or, as (—1)"~ '(—1)"~ | =(—1)"" 7 = 1, we have the pretty result 


cosin22 I(x), n (2n—2 
(7.6.4) fom @ ax = (aoe), 


0 x 22n-1 


For n=5, for example, this says 


oS Sin (5) 35n 
dx = —— = 0.42951... 
i x 256 


and a MATLAB check agrees, as quad(@(x)(sin(x).49)./x,0,1000) = 0.4292.... 
Now, looking back at (7.6.3) and multiplying through by cos(x), 


_(-1y" 


sin?“ (x) e08 (x) = "SP -So -ay(*" ; 1) asin ((2n ~ 2r~ 1)x} 605 


and remembering that sin («) cos ($) = 3[ sin (a+ B) + sin (a — B)], we have 
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sin*"-!(x) cos (x) = Se a ayr(7y } ) [sin {2(n — r)x} 
+ sin {2(n —r— 1)x}}]. 


© sin 79-1 (x) cos (x) nl en=1 2n—1 come 
aE) r n sin {2(n—r)x} 
Thus, | 5 dx = ‘Sm s - (-1) ( : ) | SHULEINSOEL 


0 


fe +[ sin {2(n — r — 1)x} os 
0 x 

For every value of r from 0 to n—1 the first integral on the right is 4, from 
Dirichlet’s integral. For every value of r from 0 to n— 1 except for r=n-— | (where 
the argument of the sine function is zero) the second integral on the right is also 5. 
For r=n-— | the second integral is zero. So, if we ‘pretend’ the r=n-— | case for 
the second integral also gives } we can write the following (where the last term 
corrects for the ‘pretend’!): 


ij sae cos (x) dx = ars cay(7y ') 


0 


Now, just as before, 


a cyr(7*7") = (aoy 


and so 
°° sin?! (x) cos (x) 4 _(-p™! att iO n (2n—1 
x= 2n-1 n(—1) a ~~ 42n = 
0 x 2 ee Boy Td 


_ it 2n-—2\ 2 /2n-1 mea 2n-—2\ /2n-1 
~ 92n-1 \ n— 1 27\ n-1 } 220 n-1 n—1/|° 
Or, since 
> 2a 2h 2 VN, ey ied 
n-1 n-1/) n\n-1 


as you can easily verify by expanding the binomial coefficients, we have 
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co sin2"~1(x)cos(x) ae 2n-—2 
(7.6.5) fe ee ae (Gua) 


0 x 22nyn 


For n= 2, for example, 


ik am 0s ge 7) = = 0.196382... 
0 x 2°2 16 


and a MATLAB check says quad(@(x)(sin(x).43).*cos(x)./x,0,1000) = 0.196382. ... 
To finish this section, notice that 


CO «os Qn 
| sin (X) 


0 x 


can be integrated by parts as follows. Let u= sin?"(x) and dv = oy. Thenv = —1 and 
du — 2nsin*"~'(x) cos (x) and we have 


© Insin*!(x) cos (x 
0 


0 Xx 


and so, looking at (7.6.5), we see that 


2 gin (x) mn (2n—2 mn (2n—2 
[) spree mabe (922) sar) 


Thus, looking back at (7.6.4) we have the interesting result that 


co sin?" (x) _ px sin29-1(x) 2 ot (zn 2 
(7.6.6) dx = f° © dy =F _( Ve 


22n-1\ n—4 


0 x2 


For example, if n= 19 (7.6.6) says 


CO otn 38 CO gin 37 
| ex =| an) a1 2°) oppyan... 
0 x? 0 x has 


and MATLAB agrees, as guad(@(x)(sin(x).438)./(x.42),0,1000) = 0.20628... and 
quad(@(x)(sin(x).437)./x,0,1000) = 0.208078... . 
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7.7 Dirichlet Meets the Gamma Function 


In this penultimate section of the chapter we’ll continue with the sequence of 
calculations we started in the previous section, that of determining 


a} 


integrals we’ve already done for the n= 1, 2, and 3 cases. To do the n> 4 cases 
becomes challenging—unless we see a new trick. That’s what I'll show you now. 
We start (you'll see why, soon) with the integral 


1 @) 
| ut le" du. 
0 


If we change variable to y = xu, then differentiating with respect to y (treating x 
as a positive ‘constant’) gives 


du = —dy. 
x 


Thus, 


foe) oo q-l 1 oo yan 1 [* 
| ute" du os | (7) e J y= | —— dy = =| yt ley dy. 
P 9 \x x 9 «x4 xT Jo 


This last integral should look familiar—it is the gamma function, defined in 
(4.1.1), equal to '(q) = (q — 1)! Thus, 


1 1 oP 
= | ut le du 


and so 


10.0) an P 1 10.0) 10.0) 
| my) dx = i sin"(x){ | ute mauha 
o 6x4 (q— Vo 0 


or, reversing the order of integration (this should remind you of the sort of thing we 
did back in Sect. 4.3), 


CO oinp 1 ee) lee) 
| a dx = | uf ew sin" (x)ax ba 
0 6x4 (q—1)Mo 0 


The inner, x-integral is easily done with integration by parts, twice. I'll let you 
fill-in the details, with the result being 
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‘CO _ 1 lo.@) 
| e “ sinP(x)dx = re | e ™ sin P-?(x)dx. 
0 pe+u’ Jo 


Suppose p is even (> 2). Then we can repeat the integration by parts, over and 
over, each time reducing the power of the sine function in the integrand by 2, until 
we reduce that power down to zero, giving a final integral of 


cue Sede p! : even. 
| ; ae [p? + u2| lp - 2) + | ... (2? +02] (i)? 


Similarly for p odd, except that we stop integrating when we get the power of the 
sine function down to the first power: 


pe ! 
| e “ sinP(x)dx = E ,p odd. 
0 [p? + u]|{(p—2)° + w? | [2 +0] 


So, we have our central results: 


idee 


xa “= (q-1)! u2 + 2?][u2 + 42] ...[u2 +p 


(7.7.1) | <a We 


7 du, p even | 


and 


is sinP (x) he p! ae du, p odd. 


7 ~ (q-0)! So [u? + 12][ u? + 32] ..[u? + p?] 


(7.7.2) 


For the question of what is 


[ef 


the question we asked (but didn’t answer) just after (7.6.2), we have p= q = 4 (and 
so p even) and (7.7.1) tells us that 
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iA {OV a ~ [. [u2 + re +47] du = fo aig” 


Making a partial fraction expansion, we have 


; 1 4 
CO - Co 3 CO 3 
| es | —du J | du 
0 x 0 u +4 0 w + 16 
fu) to wefa_, fu) UP 
= —~¢ <tan7!| +—¢ —tan7! {| — 
2 2 3 )4 4 ‘ 
-1 4 I 
= —xtan~ (oo) + 3 tan (co) 
T 
=—tan7! =|/-|{=- 
an" (oo) 313 
or, at last, 
co (sin(x) a Tt 
(7.7.3) fo RS} dx ==. 


This is 1.047197... and MATLAB agrees, as guad(@(x)(sin(x)./x)..4,0,1000) = 
1.0472... . 

You might think from all of these calculations that our integrals will always turn- 
out to be some rational number times 2. That, however, is not true. For example, 
suppose p = 3 and q=2. Then we get a result of an entirely different nature. Using 
(7.7.2) because p is odd, 


iN sin*(x) | an u d co «8 co «8 
— u 
Ae ae TI [ue +P) [we + 37] 6 |, oa | Poe as 


w+ 
u2 + 3? 


Be 2 2 a 2 9 
sin(u +1) 5in(u + 37) 


or, finally, 
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(7.7.4) 


[ sin? (x) 31n(3) 
dx = ———.. 
A 4 


x2 


This is equal to 0.8239592..., and a MATLAB check agrees, as guad(@(x)(sin 
(x).43)./(x.42),0,1000) = 0.82387... . 


7.8 Fourier Transforms and Energy Integrals 


In this section we’ll come full circle back to the opening section and its use of 
Euler’s identity. Here I’ll show you a new trick that illustrates how some physical 
considerations well-known to electrical engineers and physicists will allow us to 
derive some very interesting integrals. 

In the study of electronic information processing circuitry, the transmission of 
pulse-like signals in time is at the heart of the operation of such circuits. So, let’s 
start with the simplest such time signal, a single pulse that is finite in both amplitude 
and duration. For example, let 


la<t<b 
(7.8.1) f(t) = 
0, otherwise 


where a and b are both positive constants. (For electronics engineers, the particular 
time t = 0 is simply short-hand for some especially interesting event, like “when we 
turned the power on to the circuits’ or ‘when we started to pay attention to the 
output signal.’) The signal f(t) might, for example, be a voltage pulse of unit 
amplitude and duration b — a (where, of course, b > a). If this voltage pulse is the 
voltage drop across a resistor, for example, then the instantaneous power of f(t) is 
proportional to f°(t), which is a direct consequence of Ohm’s law for resistors, a law 
familiar to all high school physics students.” Since energy is the time integral of 
power, then the energy of this f(t), written as Ws, is (since f(t) =1) 


(7.8.2) Wi = [- f?(t)dt = [ia =b-a. 


—oo a 


All of these comments are admittedly “engineery’ in origin but, in fact, given 
(7.8.1) even a pure mathematician would, if asked for the energy of f(t) in (7.8.1), 
also immediately write (7.8.2). The physical terminology of power and energy has 
been adopted by mathematicians. Now, further pondering on the issue of the energy 
of a time signal leads to the concept of the so-called energy spectrum of that signal. 
A time signal can be thought of as the totality of many (perhaps infinitely many) 


°T mention this only for completeness. If Ohm’s law is of no interest to you, that’s okay. 
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sinusoidal components of different amplitudes and frequencies (usually written as 
@ = 2nv, where v is in cycles per second or hertz, and @ is in radians per second). 
The energy spectrum of f(t) is a description of how the total energy Wy is distributed 
across the frequency components of f(t). To get an idea of where we are going with 
this, suppose we had the energy spectrum of f(t), which I'll write as S;(@), in-hand. 
If we integrate S;(w) over all @ we should arrive the total energy of f(t), that is, Wy. 
That means, using (7.8.2), 


(7.8.3) Wr = [ f?(t)dt = [ S:(@)da = b—a 


—oo —oo 


and it’s this equality of two integrals that can give us some quite ‘interesting 
integrals.’ So, that’s our immediate problem: how do we calculate the energy 
spectrum for a given time signal? The answer is the Fourier transform. 

One of the beautiful results from what is called Fourier theory (after the French 
mathematician Joseph Fourier (1768—1830)) is the so-called Fourier transform. If 
we call G(w) the Fourier transform of an arbitrary time signal g(t), then 


(7.8.4) G(o) = [ g(t)e “dt. 


—0oo 


We can recover g(t) from G(@) by doing another integral, called the inverse 
transform: 


(7.8.5) g(t) : [ G(o)e “do. 


Together, g(t) from G(w) form what us called a Fourier transform pair,'° usually 
written as 


g(t) > Gio). 


In general, G(@) will be complex, with real and imaginary parts R(w) and X(@), 
respectively. That is, G(m) = R(w) +7 X(). If g(t) is a real-valued function of time 
(as of course are all the signals in any electronic circuitry that can actually be 
constructed) then G(@) will have some special properties. In particular, R(@) will be 
even and X() will be odd: R(—@) = R() and X(—@) = — X(o). If, in addition to 
being real, g(t) has certain symmetry properties, then G(@) will have additional 


'0 Where these defining integrals in a Fourier pair come from is explained in any good book on 
Fourier series and/or transforms. Or, for an “engineer’s treatment’ in the same spirit as this book, 
see Dr. Euler (note 1), pp. 200-204. 
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corresponding special properties. If, for example, g(t) is even (as is cos(wt)) then 
G(@) will be real, and if g(t) is odd (as is sin(wt)) then G(w) will be imaginary: 
X(@) = 0 and R(w) = 0, respectively. All of these statements are easily established 
by simply writing-out the Fourier transform integral using Euler’s identity and 
examining the integrands of the R(w) and X(@) integrals (these claims are so easy to 
verify, in fact, that they aren’t at the level of being Challenge Problems, but you 
should be sure you can establish them). 

What makes (7.8.4) and (7.8.5) so incredibly useful to us in this book is what is 
called Rayleigh’s theorem, after the English mathematical physicist John William 
Strutt (1842-1919), who won the 1904 Nobel Prize in physics and is better known 
today as Lord Rayleigh. It tells us how to calculate the energy spectrum of g(t) (and 
so, of course, of f(t), which is simply a particular g(t)). Rayleigh’s theorem is quite 
easy to derive, which makes a curious puzzle in the history of mathematics for why 
it didn’t appear in print until the relatively recent date of 1889. 

We start by writing 


and then replace one of the g(t) factors in the second integral with its inverse 
transform form from (7.8.5). So, 


Wes | g(t)g(t)dt = | o{ =| G(o)e ao hae 
Reversing the order of integration, 


W, = [- -G(0){ | g(te “at aw 


90 20 ea 


Since g(t) is a real-valued function of time—what would a complex-valued 
voltage pulse look like on an oscilloscope screen!?—then the inner t-integral on 
the right is the conjugate of G(@) because that integral looks just like (7.8.4) except 
it has +7 in the exponential instead of — i. That is, 


[- g(t)e “dt = G*(@) 


—oo 


and so 
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Or, if we now specifically let g(t) = f(t), then Rayleigh’s energy theorem is 


We = | Fe) do = | f? (t)dt, F(o) = R(o) a iX(@), 


—0oo —Oo 


and so the energy spectrum of the f(t) in (7.8.1) is, by (7.8.3) 


+ ~OO <0 < OH. 


For all real f(t), IF(@)? = R’(@) +X7(o) will be an even function because both 
R’(@) and X’(o) are even. 
The Fourier transform of f(t) in (7.8.1) is 


loo) ; b : —iot) )b iob — ,—iwa ioa __ i@b 
F(o) = | f(t)e*at = | onlay = {" | \ Raia 
= yi —i@ J la —i@ i@ 
and so the energy spectrum of f(t) is 
| —iwa —iab |? 
e e 
7.8.6 S = 
( ) (0) 2nw2 
Inserting (7.8.6) into (7.8.3), we get 
% 510, 
1 f% lees _ ev iad 
(7.8.7) =|. oe do = b-—a. 


Now, temporarily forget all the physics I’ve mentioned, that is, put aside for now 
all that business about time functions and energy distributed over frequency, and 
just treat (7.8.7) as a pure mathematical statement. To be absolutely sure we are 
now thinking ‘purely mathematical,’ let’s change the dummy variable of integra- 
tion from @ to x, to write 


(7.8.8) dx =b-—a, b>a. 


1 i leu — e—ixb 2 


20} 6 x2 


Concentrate for the moment on the numerator of the integrand in (7.8.8): using 
Euler’s identity we have 
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eka _ ew ix |? = |{ cos (ax) — isin (ax)} — { cos (bx) — isin (bx)}|* 
= |{ cos (ax) — cos (bx)} — i{ sin (ax) — sin (bx)}|* 
= { cos (ax) — cos (bx)}? + { sin (ax) — sin (bx)}’ 
which, if you multiply-out and combine terms, becomes 
= 2[1 — { cos (ax) cos (bx) + sin (ax) sin (bx) }]. 


Putting this into (7.8.8), we arrive at 


“| 1 — { cos (ax) cos (bx) + sin (ax) sin (bx) I ay shiek Hea 


4 x2 


—oo 


or, in very slightly rearranged form (you’ll see why, soon), 


r 1 — cos (ax) cos (bx) ae [- sin (ax) sin (bx) dx =2(b—a), b>a. 


2 2 
“4 x x 


(7.8.9) 


Next, look back at (3.4.1), which we can use to write the integral (as the special 
case of the parameters there found by setting a to zero and b to one) 


lo.@) 1 = 
| 8 (u) a * 
0 u 2 


or, as the integrand is even, 


(7.8.10) 


We now change variable in (7.8.10) to u=(a+b)x, and so 


[- 1 — cos (ax + bx) 


a+b)dx=2z 
as (a + b)?x? ( ) 


or, using the trigonometric identity for cos(ax + bx), 


[- 1 — [cos (ax) cos (bx) — sin (ax) sin (bx)] 


2 dx = (a+b)x 


—oo 
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and so, in very slightly rearranged form, 


dx = x(a+b). 


crit) [1 eesterdeos(s) gy 4 f sin(an) sin(Ps) 


x2 x2 


Finally, subtract (7.8.9) from (7.8.11), to get 


ee a(b 
2| sn § one bia 2) =a 


x2 


or, at last, 


[° sin (ax) sin (bx) pnt ee 


x2 


Of course, by the symmetry of the integrand we could equally-well write 


IE sin (ax) sin (bx) oe 


x2 


—oo 


Both of these statements can be written as one, as 


(7.8.12) dx = tmmin(a,b). 


\ sin(ax) sin(bx) 


x2 


As a special case, if a= b then (7.8.12) reduces to 


[- sin (ax) 
—— dx = na 
Xx 


—0oo 


which is just (7.6.1) with a= | (see also Challenge Problem 7.5). 
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In this section Pll show you some quite interesting (almost bizarre) integrals that 
arise in the theory of radio (although I'll limit the discussion to pure mathematics, 
and not a single transistor, capacitor, or antenna will make an appearance). Let’s 
start by recalling Dirichlet’s integral from (3.2.1): 
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= t>0 
co sin(ta) 2 
(7.9.1) [odo = 
TT 
—Z.t<0 


where I’ve replace the parameters a and x in (3.2.1) with the parameters t and o, 
respectively. Since the integrand in (7.9.1) is even, we can double the integral by 
integrating from — oo to oo. Thus, 


(7.9.2) fe dw = 


—0o 


In radio engineering analyses it is found that a time signal that is — | for negative 
time and + 1 for positive time is highly useful (you’ll see why, soon). It is given the 
special name signum—written sgn(t)—for its property of being the sign function 
(not to be confused with the sine function!). So, (7.9.2) can be written as 


[- sin (to) 


@ 


do = x sgn(t). 


—0o 


Notice that using Euler’s identity we can write 


lo-e) iot oe) t [o-e) . t 
| “wo = | tO 0+] sin (@t) 4 
oo ® en) en) 


and, as the first integral on the right vanishes since its integrand is odd, we have 


(7.9.3) ce 22s =a sgn(t). 


—00 q 


Another time signal that radio engineers find useful, one closely related to sgn(t), 
is the so-called unit step, equal to zero for negative time and to + 1 for positive time. 
Written as u(t), we can connect u(t) to sgn(t) by writing 


(7.9.4) Mc ee 
2 
The unit step is a constant for all t except at t=0 where it instantly jumps from 
0 to | as t passes from being negative to being positive. This jump occurs in zero 
time, and so the ‘derivative’ of u(t) is infinite at t=O and zero for all t40. Fora 
long time mathematicians did not consider the derivative of u(t) to be a respectable 
function, but nonetheless the English physicist Paul Dirac (1902-1984) showed that 
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working with such a thing—called an impulse function and written as 6(t)—could 
indeed be quite useful.'' Dirac formally wrote 


and so, formally differentiating (7.9.4), we have 


a(t) = 5 (SO) = 55 (oan) 


Now, if (as usual in this book) we boldly assume we can differentiate under the 
integral sign in (7.9.3), then 


00 


d oe fot d d . i@t lee) ; 
| a= a sgn(t)} = inal sgn(t)} = | d= | el do. 


That is, 
(7.9.5) | da nm {sen(t)}. 


From our differentiation of (7.9.4) we have 


Cult) = 8(t) = 5 © {sen(t)} 
and so 
© {sgn(t)} = 26(t) 


Putting this into (7.9.5), we have 


"| Although Dirac won the 1933 Nobel Prize in physics, he was the Lucasian Professor of 
mathematics at Cambridge University. His physical insight into such a bizarre thing as an infinite 
derivative was powered (by his own admission) with his undergraduate training in electrical 
engineering: he graduated with first-class honors in EE from the University of Bristol in 1921. 
Dirac was clearly ‘a man for all seasons’! The mathematics of impulses has been placed on a firm 
theoretical foundation since Dirac’s intuitive use of them in quantum mechanics. The central figure 
in that great achievement is generally considered to be the French mathematician Laurent 
Schwartz (1915-2002), with the publication of his two books Theory of Distributions (1950, 
1951). For that work, Schwartz received the 1950 Fields Medal, often called the ‘Nobel Prize of 


mathematics.’ 
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(7.9.6) J elt dw = 278(t). 


The statement in (7.9.6) is an astonishing one because the integral just doesn’t 
exist if we attempt to actually evaluate it, since e“”' doesn’t even approach a limit as 
lol > oo. The real and imaginary parts of e“”* both simply oscillate for all t other 
than zero as @ varies. The only way we can make any sense of (7.9.6) is, as Dirac 
did, by interpreting the integral on the left as a collection of printed squiggles that 
denote the same concept as do the printed squiggles on the right (for which we at 
least have a physical feel). Any time we encounter the integral squiggles we’ll just 
replace them with the squiggles ‘276(t).’ As you’ll soon see, impulses can occur 
with arguments more complicated than just ‘t,’ and the general rule is that an 
impulse goes to infinity when its argument vanishes. So, for example, 5(t — tg) is 
zero for all tA to and infinity at t= to. 

With (7.9.3) and (7.9.6) we can now find the Fourier transforms of sgn(t), S(t), 
and u(t). For sgn(t), I claim its transform is 2 . To see this, put = into the inverse 
transform integral of (7.8.5) to get 


1 love) D . . 1 lo-@) i@t 
=| —e'' da = -| ode 
20) _ 4. I@ Ti @ 


—0o 


and then recall (7.9.3) which says the integral on the right is ix sgn(t). That is, 


1 elot 1 
do = —i th= t). 
| 9 1? = at sgn(t) = sgn(t) 


So, we have the transform pair 


(7.9.7) sgn(t) 7 


The energy spectrum of sgn(t) is 
Lal 


se ae a 


-wo<a< ow 


and so, if we integrate this spectrum over all @, we get infinity. That is, sgn(t) is an 
infinite energy signal (something obvious from the get-go, of course, for a signal 
whose magnitude is 1 for all time), a clear clue that it is impossible to actually 
generate it! 
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Next, I claim the Fourier transform of 6(t) is 1, and again you can see this by 
putting 1 into the inverse transform integral of (7.8.5) to get 


1 = 1 iat q, oe! i jot q 
on e ame! e @ 


—Ooo —oo 


and then recall (7.9.6) which says the integral on the right is 278(t). So, we have the 
transform pair 


(7.9.8) Ota 


The energy spectrum of 6(t) is uniform over all @ or, as radio engineers 
sometimes put it, 5(t) has a flat spectrum.'* From Rayleigh’s theorem we see that 
6(t), like sgn(t), is an infinite energy signal and so is impossible to actually generate. 
Unlike sgn(t), this infinity is not obvious from the time behavior of the impulse 
(which property dominates, the infinite value at one instant of time, or the fact that it 
is just one instant of time?). It’s the energy spectrum that gives us the answer. 

Now, what is the transform of the unit step, u(t)? From (7.9.4) we can write the 
transform of u(t) as the sum of the transforms of 5 and 5sgn(t). That is, using (7.9.7), 
we have 
od 


1 
= alot dt — 
=a 2 ° * i@ 


(7.9.9) CES | 

‘All’ we have to do is figure-out what the integral on the right in (7.9.9) is—and 
to do that, let me show you a neat little trick in notation. Look back at (7.9.6). Since 
it is an equality it remains an equality if we perform exactly the same operations on 
both sides. So, on the left replace every w with t, and every t with @, and on the right 
do the same. Then, 


(7.9.10) 


| elt dt = 215(w) 


where 5(w) is an impulse in the w-domain. Just as 6(t) is zero for all t40 and 
infinite at t = 0, 5(@) is zero for all @ ¢ 0 and infinite at m = 0. That is, all the infinite 
energy of a signal that is a constant for all time should have no energy at any 


'2Tn an analogy with white light, in which all optical frequencies (colors) are uniformly present, 
such an energy distribution is also often said to be a white spectrum. To continue with this 
terminology, signals with energy spectrums that are not flat (not white) are said to have a pink 
(or colored) spectrum. Who says radio engineers aren’t romantic souls?! 
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non-zero frequency, because otherwise the signal wouldn’t be constant but rather 
would have a time-varying component. 
Next, change variable in (7.9.10) to u= — t (dt = — du). Then, 


| e" dt = | el) (—du) = | e ™ du. 


—oo o.<) —Ooo 


That is, 
2n8(w) = | e '" du 


—oo 


or, if we change the dummy variable of integration from u back to t, 


(7.9.11) [er “de = 25a), 


Notice, from (7.9.10) and (7.9.11), that we’ve shown 


| e"® dt = 2n8(@) = | e ™ dt. 


—0o —Ooo 


That is, 5(—@) = 6(@) and so the impulse function, mathematically, is even. In 
any case, the integral on the right in (7.9.9), the Fourier transform of 5. is 75(@), and 
so we now have the pair 


(7.9.12) u(t) — 15(o) = 


and so of course, like sgn(t) and 6(t), u(t) is an infinite energy signal. 

We can expand on the physical meaning of 5(@) by computing the Fourier 
transform of the pure sinusoidal signal cos(@ot), — 00 <t < oo. By definition, the 
transform is 


aS ‘ 3 
e 1Mot +4 e 1@ot 


tot gt 
5) e 


| cos (@ot)e “dt = | 


—oo —0o 


= Al e Moo) dt + Al e Motoo)t dt. 


—oo —0o 


Recalling (7.9.11) we see that the first integral on the right is 215(@ — @o) and the 
second integral on the right is 226(@ + Wo). So, we have the pair 
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(7.9.13) cos (Mot)  25(@ — Wo) + 15(@ + Wo). 


Since an impulse ‘occurs’ where its argument is zero, we see that all the (infinite) 
energy of the pure sinusoidal time signal cos(@ot) is equally concentrated at the two 
frequencies'* @ = +@p. 

There is one final property of the impulse function that is important to state. 
Returning to Dirac’s formal definition of the impulse as derivative of the step, that is to 


a(t) =< {u(t} 


then if we formally integrate this we get 


t 


[soy =] Ztuopay= | ataiyy} = uo9]!,. = wl — u(-oo) 


or, because u(—oo) = 0, 


1,t>0 
food =uO)= OO . 
0,t<0 

That is, even though the impulse has zero duration, it is nonetheless ‘so infinite’ 
that it bounds unit area! This is impossible to justify in the framework of nineteenth 
century mathematics, which is why mathematicians for so long dismissed the 
impulse as being utter nonsense (electrical engineers and physicists, however, 
didn’t have much of a problem with it because the impulse solved many of their 
‘real-life’ problems)—until the work of Laurent Schwartz. 

One intuitive way to ‘understand’ this result (a view common among physicists 
and radio engineers), is to think of the impulse as a very narrow pulse of height 4+ for 
—5<t<45 (where 0), and with zero height for all other t. (Notice that this 
makes the impulse even, as we concluded it must be after deriving (7.9.11).) For all 
e€ this pulse always bounds unit area, even as we let e — 0. So, suppose p(t) is any 
function that is continuous at t= 0. Then, during the interval —5 < t < 5, p(t) can’t 
change by much and so is essentially constant over that entire interval 
(an approximation that gets ever better as we let e — 0) with value (0), and so 
we can write 


'3 There are two frequencies in the transform because of the two exponentials in the transform 
integral, each of which represents a rotating vector in the complex plane. One rotates counter- 
clockwise at frequency + @o (making an instantaneous angle with the real axis of wot) and the other 
rotates clockwise at frequency — Wo (making an instantaneous angle with the real axis of — wot). 
The imaginary components of these two vectors always cancel, while the real components add 
along the real axis to produce the real-valued signal cos(@pt). 
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More generally, if (t) is continuous at t=a then 


(7.9.14) [7 8(t — a) p(t) dt = (a). 


The integral of (7.9.14) is often called the sampling property of the impulse. 

Now, to finish this section I'll take you through three simple theoretical results in 
Fourier transform theory. We’ll find all three highly useful in the next section. To 
start, we can use the same notational trick we used to get (7.9.10) to derive what is 
called the duality theorem. Suppose we have the transform pair g(t) ~ G(@). Then, 
from the inverse transform integral (7.8.5), we have 


g(t) = ain G(o)e “do 


or, replacing t with -t on both sides of the equality (which leaves the equality as an 
equality), we have 


g(—-t) = =|. G(o)e "da. 


—oo 


Then, using our symbol-swapping trick again (so it’s a method!)—teplace t with 
@, and w with t—we get 


g(—o) = =e G(t)e "de 


27) 6 
or, 
2ng(—w) = | G(t)e "do 
That is, 
(7.9.15) ne) 


then G(t) © 2mg(—a) * 


Our second result, called the time/frequency scaling theorem, starts with the 
given transform pair f(t) ~ F(@). We then ask: what is the transform of f(at), where 
a is a positive constant? The answer is of course 
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| f(at)e dt 


—0o 


which, if we change variable to u=at (dt = wy, becomes 


[- f(u)e Oe Al f(u)e C2)" du = r(°). 


55 a a 


That is, 


if f(t) O F(w) 


(7.9.16) then f(at) o - i) 


And finally, given the two time functions g(t) and m(t), with Fourier transforms 
G(@) and F(@), respectively, what is the Fourier transform of m(t)g(t)? By defini- 
tion, the transform is 


[- m(t)g(t)e dt = [- m(){ : [- G(u)e™" duberw! dt 


99 —oo 2n —oo 


where g(t) has been written in the form of an inverse Fourier transform integral 
(I’ve used u as the dummy variable of integration in the inner integral, rather than a, 
to avoid confusion with the outer w). Continuing, if we reverse the order of 
integration we have the transform of m(t)g(t) as 


[. Glu) {{ m(t)elt e ar} du = =|. aw m(t) eet ar} du 


or, as the inner integral is just M(@ — u), we have the Fourier transform pair 


(7.9.17) m(t)g(t) of", G(u)M(w — u) du. 


The integral on the right in (7.9.17) occurs so often in mathematical physics that it 
has its own name: the convolution integral, written in short hand as G(q) * M(a).'* 


4 Note, carefully: the * symbol denotes complex conjugation when used as a superscript as was 
done in Sect. 7.8 when discussing the energy spectrum, and convolution when used in-line. 
Equation (7.9.16) is called the frequency convolution integral, to distinguish it from its twin, the 
time convolution integral, which says m(t) * g(t) G(w)M(@). We won’t use that pair in what 
follows, but you should now be able to derive it for yourself. Try it! 


266 7 Using —1 to Evaluate Integrals 


Since it is arbitrary which time function we call m(t) and which we call g(t), then in fact 
convolution is commutative and so m(t)g(t) + +G(@) * M(@) = +M() * G(@). 

We'll use (7.9.17) in the next section as a purely mathematical result but, to finish 
this section, you may find it interesting to know that it is the reason radio works. 
Here’s why. Imagine Alice and Bob are each talking into a microphone at radio 
stations A and B, respectively. Since the sounds produced by both are generated via 
the same physical process (vibrating human vocal chords), the energies of the two 
voice signals will be concentrated at essentially the same frequencies, typically a 
few tens of hertz up to a few thousand hertz. That is, the frequency interval occupied 
by the electrical signals produced on the wires emerging from Alice’s microphone is 
the same as the frequency interval occupied by the electrical signals produced on the 
wires emerging from Bob’s microphone. This common interval of frequencies 
determines what is called the baseband spectrum, centered on o = 0. 

To apply the baseband electrical signal from a microphone directly to an antenna 
will not result in the efficient radiation of energy into space, as Maxwell’s equations 
for the electromagnetic field tell us that for the efficient coupling of the antenna to 
space to occur the physical size of the antenna must be comparable to the wavelength 
of the radiation (if you’re not an electrical engineer or a physicist, just take my word 
for this). At the baseband frequency of 1 kHz, for example, a wavelength of electro- 
magnetic radiation is one million feet, which is pretty long. To get a reasonably sized 
antenna, we need to reduce the wavelength, that is, to increase the frequency. 

What is done in commercial broadcast AM (amplitude modulated) radio to 
accomplish that is to shift the baseband spectrum of the microphone signal up 
somewhere between about 500 kHz to 1,500 kHz, the so-called AM radio band. 
(Each radio station receives a license from the Federal Communications Commis- 
sion—the FCC—that gives it permission to do the upward frequency shift by a 
value that no other station in the same geographical area may use.) At 1,000 kHz, 
for example, the wavelength is a thousand times shorter that it is at 1 kHz—that is, 
1,000 feet. If a station’s antenna is constructed to be a quarter-wavelength, for 
example, then it will have an antenna 250 feet high, which is just about what you’ ll 
see when next drive by your local AM radio station’s transmitter site. 

So, suppose that at station A Alice’s baseband signal is up-shifted by 900 kHz, 
while at station B Bob’s baseband signal is up-shifted by 1,100 kHz. A radio receiver 
then selects which signal to listen to by using a tunable filter centered on either 
900 kHz or 1,100 kHz (in AM radio, the bandwidth of such a filter is 10 kHz, and 
knowing how to design such a filter is part of the skill-set of radio engineers). Note that 
radio uses a frequency up-shift for two reasons: (1) to move baseband energy up to 
so-called ‘radio frequency’ to achieve efficient radiation of energy and (2) to separate 
the baseband energies of multiple radio stations by using a different up-shift frequency 
at each station. At a receiver we need a final frequency down-shift to place the energy 
of the selected station signal back at the baseband frequencies to which our ears 
respond. 
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To accomplish these frequency shifts, both up and down, is as simple as doing a 
multiplication. '° Here’s how (7.9.17) works for the transmitter up-shift. Let M(@) 
be the Fourier transform of either Alice’s or Bob’s baseband microphone signal. 
Then, remembering (7.9.13), the transform for cos(@ot), (7.9.17) tells us that the 
transform of m(t)cos(@ot) is 


M(@) * [25(@ — wo) + 28(@ + @o)] = | [x5(u — wo) + 25(u + o)|M(@ — u) du 


—co 


= | 5(u — 0o)M(@ — u)du + | 8(u + @o)M(@ — u)du 


and so, remembering (7.9.14), the sampling property of the impulse, the transform 
of m(t)cos(@pt) is 5M(o —@o) + 5M(o + @o). That is, while the energy spectrum of 
m(t) is centered on w=0, the energy spectrum of m(t)cos(@ot) is centered on 
@=+ . The energy spectrum of the original baseband signal m(t) now rides 
piggy-back on cos(@ot) (picturesquely called the carrier wave by radio engineers), 
and is efficiently radiated into space by a physically ‘short’ antenna. When used in 
radio, (7.9.17) is called the heterodyne theorem.'° 
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You'll recall that in Sect. 7.8 I made the following statements about the general 
transform pair g(t)<+ G(w): In general, G(w) will be complex, with real and 
imaginary parts R(w) and X(@), respectively. That is, G(w) = R(w)+/ X(@). If g 
(t) is a real-valued function of time (as of course are all the signals in any electronic 
circuitry that can actually be constructed) then G(w) will have some special 
properties. In particular, R(@) will be even and X(w) will be odd: R(—w) = R(@) 
and X(—@)=— X(@). If, in addition to being real, g(t) has certain symmetry 
properties, then G(w) will have additional corresponding special properties. If, for 
example, g(t) is even (as is cos(@t)) then G(@) will be real, and if g(t) is odd (as is sin 
(wt)) then G(w) will be imaginary: X(@) = 0 and R(w) = 0, respectively. 


'STo be honest, multiplying at radio frequencies is not easy. To learn how radio engineers 
accomplish multiplication without actually multiplying, see Dr. Euler, pp. 295-297, 302-305, or 
my book The Science of Radio, Springer 2001, pp. 233-249. 


‘©The mathematics of all this was of course known long before AM radio was invented, but the 
name of the theorem is due to the American electrical engineer Reginald Fessenden (1866-1932), 
who patented the multiplication idea in 1901 for use in a radio circuit. The word ‘heterodyne’ 
comes from the Greek heteros (for external) and dynamic (for force). Fessenden thought of the cos 
(@ot) signal as the ‘external force’ being generated by the radio receiver circuitry itself for the final 
frequency down-shift of the received signal to baseband (indeed, radio engineers call that part of 
an AM radio receiver the /ocal oscillator circuit). 
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If we now impose even further restrictions on g(t) then, as you’d expect, there will 
be even further restrictions on R(@) and X(@). One restriction that is fundamental to 
the real world is causality. To understand what that means, suppose we have what 
electronics engineers call a ‘black box,’ with an input and an output. (The term 
“black box’ means we don’t know the details of the circuitry inside the box and, 
indeed, we don’t care.) All we know is that if we apply an input signal starting at time 
t =0 then, whatever the output signal is, it had better be zero for t < 0. That is, there 
should be no output before we apply the input. Otherwise we have what is called an 
anticipatory output, which is a polite name for a time machine! So, there’s our 
question: If g(t) is the output signal, a signal real-valued and zero for all t < 0, what 
more can we say about its Fourier transform G(@) = R(@) +i X(w)? 

To start our analysis, let’s write g(t) as the sum of even and odd functions of 
time, that is, as 


(7.10.1) g(t) = g.(t) + g(t) 
where, by definition, 
g.(—t) = g(t), £,(—1) = =,( 0) 


That we can actually write g(t) in this way is most directly shown by simply 
demonstrating what g,(t) and g,(t) are (we did this back in Chap. 1, but here it is 
again). From (7.10.1) we can write 


(7.10.2) g(—t) = g.(—t) + g.(—t) = g(t) — g(t) 
and so, adding (7.10.1) to (7.10.2) we get 


1 


(7.10.3) 8-(t) = sle(t) + e(—t)], 


and subtracting (7.10.2) from (7.10.1) we get 


1 


(7.10.4) So(t) = sig(t) — (—t)]. 


So, (7.10.1) is always possible to write. 


Since g(t) is to be causal (and so by definition g(t) =0 for t< 0), we have from 
(7.10.3) and (7.10.4) that 


ge(t) = a(t) 


L ift>0 
Bo(t) = 5a(t) 
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and 
ge(t)=sa(-) 
CQ ift <0 
go(t)=—Sa(-) 
That is, 
g-(t)=g,(t), t>0 
g.(t) = —g,(t), t<0 
and so 
(7.10.5) g.(t) = g4(t)sgn(t). 


In a similar way, we can also write 
(7.10.6) So(t) = ge(t)sgn(t). 
Now, because of (7.10.1) we can write 
G(o) = G.(o) + G,(o) 


and since g,(t) is even we know that G.(@) is purely real, while since g,(t) is odd we 
know that G,(@) is purely imaginary. Thus, 


(7.10.7) G.(@) = R(@) 
and 
(7.10.8) G,.(w) =i X(@). 


Now, recall the transform pair from (7.9.7): 


and so, using (7.10.7) and (7.10.8), 
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(7.10.9) R(@) = —i X(@) * — = * xX(o) — 


1 2 
G,(@) = 5 G.(@) 7 
and so, using (7.10.7) and (7.10.8), 
1 2 
i X(@) =e (@) re 
or, 
(7.10.10) Re) Se 
1 0) 


Writing (7.10.9) and (7.10.10) as integrals, we arrive at 


R(w) = 2° = du 
(7.10.11) oe 


K(w) = -2 f° 


du 


ow-u 


These two equations show that R(@) and X(@) each determine the other for a 
causal signal. The integrals that connect R(m) and X(@) are called Hilbert trans- 
forms,'’ a name introduced by our old friend throughout this book, G. H. Hardy. 
Hardy published the transform for the first time in English in 1909 but, when he 
later learned that the German mathematician David Hilbert (1862-1943) had 
known of these formulas since 1904, Hardy began to call them Hilbert transforms. 
But Hilbert had not been the first, either, as they had appeared decades earlier in the 
1873 doctoral dissertation of the Russian mathematician Yulian-Karl Vasilievich 
Sokhotsky (1842-1927). 


' They are also sometimes called the Kramers-Kronig relations, after the Dutch physicist Hendrik 
Kramers (we encountered him back in Sect. 6.5, when discussing the Watson/van Peype triple 
integrals), and the American physicist Ralph Kronig (1904-1995), who encountered (7.10.11) 
when studying the spectra of x-rays scattered by the atomic lattice structures of crystals. See 
Challenge Problem 7.9 for an alternative way to write (7.10.11). 
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Notice that the Hilbert transform does not change domain, as does the Fourier 
transform. That is, in (7.9.11) the Hilbert transform is in the same domain (@) on 
both sides of the equations. One can also take the Hilbert transform of a time 


function x(t), getting a new time time function'® written as x(t): 


(7.10.12) x() = al A) es 


For example, if x(t) is any constant time function (call it k) then its Hilbert 
transform is zero. To show this, Ill use our old ‘sneak’ trick to handle the integrand 
singularity at u=t. That is, 


—— lf k k te gq T od 
x(t) = | du = “limo, | Z +| “ 


t—u _pt—-uJy.t—ul 


Changing variable in both integrals on the right to s = t — u (ds = — du), then 


—— k € d t —T d 
x(t) = 1 lim,_.0, +00 | ~ = oF | _ = 
t+T S —€e S 


k t+T gq —e d k 3 
= 7 LiMe+0, 7-00 | : + | : = 7 liMle+0,T-+00 [in(s) Ir + In(s) Bel 


e S 


t-T § 


= “time o.1-olin( + T) — In(e) + In(—e) — In(t — T)] 


li eae ee ee 
= —lime.0.T-+00 | In| —— n 
: € t—T 
ak 1 t+T € 

>= i IMg—0,T—00 } Nn € T_t 


and so, noticing that the e’s cancel, 


'8Combining a time signal x(t) with its Hilbert transform to form the complex signal 


z(t) = x(t) +ix(t), you get what the Hungarian-born electrical engineer Dennis Gabor (1900- 
1979)}—he won the 1971 Nobel Prize in physics—called the analytic signal, of great interest to 
engineers who study single-sideband (SSB) radio. To see how the analytic signal occurs in SSB 
radio theory, see Dr. Euler, pp. 309-323. 
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x(@) = Stim inf (Ft) b] = Sin(1) =o. 


This gives us the interesting 


(7.10.13) 


To finish this section, let me now take you through the analysis of a particular 
causal time signal, which will end with the discovery of yet another interesting 
integral. To start, recall the Fourier transform of the f(t) in (7.8.1): 


e iwa _ e lab 
F(@) = 
(o) a 
for 

la<t<b 

f(t) = i . 
0, otherwise 

Suppose we seta = 4 andb = 5. We then have a signal that is important enough 


in radio engineering to have its own name (it is called the gate function), and its 
own symbol, x(t). That is, 


1-5<t<s 
(7.10.14) n(t) = | 


0, otherwise 


The Fourier transform of x(t) is 


ioe iat aD Gin (@ in (2 
Ginds) Tie) =<—— ee) 8a) eae 


From the duality theorem of (7.9.15) we have, from (7.10.14) and (7.10.15), the 
19 
pair 


'° Note, carefully, the dual use of the symbol “x”—once for the number, and again for the name of 
the gate function. There will never be any confusion, however, because the gate function will 
always appear with an argument while x alone is the number. 
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II(t) — 2x x(—o) 


and so 


(7.10.16) 


because m(@) is an even function. Next, applying the time/frequency scaling 
theorem of (7.9.16) with a= 2, (7.10.16) says 


S00 san) 


Since the gate function is 1 over the interval for which its argument is in the 
interval —} to 5 (this interval is —} << $< 4, or —1<@< 1), we have 


; Tt, -l<w<l 
(7.10.17) Oe c 
: 0, otherwise 

Now, the time signal in (7.10.17) is not a causal signal since it exists for all t, but 
we can use it to make a causal signal (zero for t <0) by multiplying it by the step 
function. That is, 


is a causal time function. As we showed at the beginning of this section, we can 
always write any causal time function as the sum of an even function and an odd 
function, where the even function is 5g(t), which for our problem here is ants, 

You'll also recall that we showed the real part of G(w) is due entirely to this even 


time function. So, 


sin (t) 
2t 


~ R(o). 


Looking back at (7.10.17), we see that 


; : oi -1<o<1 
(7.10.18) sin(t) _ {sin} © R(w) = ps 


2t 2 t 


0, otherwise 


So, from (7.10.11) we can find X(@), the imaginary part of G(@), as 
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X(o) = a. RQ) a= sf du 


A @—u 2)_,®-u 


—oo 


Doing this integral isn’t quite as straightforward as it might initially appear. 
That’s because there is a singularity at u= a. If lol > 1 this singularity is not in the 
interval of integration and we can proceed in the obvious way. Change variable to 
S=@-—u and so ds = — du. Then, 


If?! (-ds\ 1°" /ds\ 1 ot 1, for 1 
to) fo. ( s shoe (5) 2 mS) 2 (i ar 4 PI 
For lol > 1 the argument of the log function is positive and all is okay. For the 
case of lal < 1, however, the argument is negative and the log function gives an 
imaginary result, which is not okay. The reason for this difficulty is that the 


singularity is in the interval of integration when lal < 1. 
The fix is to use our sneak trick. In the limit as e — 0 we write 


vo altel ef -all. 0) 


1 € o-1 1 € = 
= 5|Im(s)|6.4 + n(s)| |=3 In rll +In = 

1 € 

2 7 @+1 ven € 


or, as the e’s cancel even before we let ¢ — 0, 


1 l1—@ 
go ea (=). 


We can handle both cases, la! > 1 and lol < 1, simultaneously, by writing 


o| <1. 


(7.10.19) X(@) = sin( 


1-—o 
1+o 


}.-00 <0 <0o, 


Now, from Rayleigh’s energy theorem and (7.10.7) we can write 
lo.@) 1 10.6) 
| g2(t)dt = =| R’(w)da, 


-— 27) oo 


and from Rayleigh’s energy theorem and (7.10.8) we can write 
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Ie g2(t)dt = =|. X?(@)do. 


—0oo 


From (7.10.5) or (7.10.6) we see that the time integrals are clearly equal, and so 
then must be the frequency integrals. That is, for a causal signal, 


[- R?(o)do = [ X?()do. 


—oo —oo 


Since (7.10.18) says 
love) 1 2 2 
| R?(o)do = . “do = 5 


—0oo 


then using (7.10.19) in the X(@) integral we have 
ean | no) 

In? { | 

iz 4" ( l+o@ 


1o.¢) 1 10.0) 
or, since | = 5| , we have the pretty result 
0 


(7.10.20) [ In? (|; 7 *|) ax =. 


This is 9.8696..., and MATLAB agrees as quad(@(x)log(abs((x-1)./(x+1))). 
A2,0,10000) = 9.8692... . 


7.11 Challenge Problems 


(C7.1): What are the values of 


for n=5, 6, and 7? 
(C7.2): Use Euler’s identity to show that if 
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F(x) = [- [- sin (t? — u’)dt du 


x 


then F(x) is identically zero (that is, F(x) = 0 for all x). Hint: Look back at Sect. 6.4, 
to the discussion there of the Hardy-Schuster optical integral, where we used the 
trig formula for cos(a — b) to establish that if C(x) and S(x) are the Fresnel cosine 
and sine integrals, respectively, then C(x) + S?(x) = ee ibs cos(t? - u’)dt du. Start 


o.<) 


now with | el dt = C(x) + iS(x) and see where that takes you. (At some point, 


xX 


think about taking a conjugate.) This is (I think) not an obvious result, and just to 
help give you confidence that it’s correct, the following table shows what 
MATLAB’s Symbolic Math Toolbox numerically calculated for the value of 
F(x) for various arbitrarily selected values of x, using the code 


syms t u 
int(int(sin(t42-u/2),t,x,inf),u,Xx,inf) 


The numerical value of x was substituted into the second line before each 
execution. 


x F(x) 
a4 —1x 107%? — 3.03x107 *4 
2 0 
0 0 
—1.6x 10° #4 
5 —9x 10° *° 
29 —2x 107 37 


(C7.3): In a recent physics paper~’ integrals of the form 


| i dx 

—0o 1 - ix3 

occur. The authors state, without proof, that this integral exists. Show this claim is, 
in fact, true. Hint: use the theorem from calculus that says 


i f(x) dx 


—oo 


< |" [tG|ax 


—oo 


which, using the area interpretation of the Riemann integral, should be obvious to 
you for the case where f(x) is real. Using contour integrals in the complex plane (see 
Chap. 8), this theorem can be extended to the case where f(x) is complex. 


?°Carl Bender, et al., “Observation of PT phase transitions in a simple mechanical system,” 
American Journal of Physics, March 2013, pp. 173-179. 
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(C7.4): Recall the integral we worked-out in the first chapter (Sect. 1.8), 
oo fx} — 1 
| Uo =-1+ In(V 2n), as well as the integrals of the second and third 
x 


{x} 


— dx = 1 — y where {x} is the fractional part 


x 
: xo «ol 3 a {x} . 

of x and y is Euler’s constant, and €(3) = Do leer 3 7 Ox. See if you 

= a 


1 


challenge problems of Chap. 5: | 


lo) 
1 


can apply the same trick we used there to show that 


now that we’ve formally calculated €(2) = m (in Sect. 7.4). MATLAB may help 
give you confidence this is correct, as | — a = 0.177532... while quad(@(x)Q- 
floor(x))./x.43,1,100) = 0.177279... . 


(C7.5): Derive a more general form of (7.6.1) by differentiating 


© sin? (ax 
I(a) = | Sin (0) ay 


with respect to a. That is, show that I(a) = §|a|, and so (7.6.1) is the special case of 
a= 1. 


(C7.6): Look back to Sect. 4.3, to the results in (4.3.10) and (4.3.11), and show how 
the Fresnel integrals immediately follow from them. 


e *O0<t<m 
(C7.7): Apply Rayleigh’s theorem to the time signal my 
0, otherwise 
where a and m are both positive constants. Hint: you should find that you have 
re-derived (3.1.7) in a way far different from the method used in Chap. 3. 


(C7.8): Calculate the Fourier transforms of the following time signals: 


(c) 48(t) + ish; 


00 @ou 
du, t>0 


@ EO =a! r0 

Hint: For (a) you may find (3.1.7) helpful, for (b) don’t forget Feynman’s 
favorite trick (of differentiating integrals), and for (c) keep (7.9.3) and (7.9.14) in 
mind. (The Fourier transform of the complex time signal in (c) is at the heart of SSB 
radio.) And finally, for (d), make the change of variable x = {, write the Fourier 
transform integral (which will of course be a double integral), and then reverse the 
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order of integration. (The perhaps mysterious-looking E(t) is the exponential- 
integral function, and it occurs in many advanced applications of engineering and 
physics. For an example of this, in a study of long free-falls through a variable 
density atmosphere with a square-law drag force, see my book Mrs. Perkins’s 
Electric Quilt and other intriguing stories of mathematical physics, Princeton 
University Press 2009, pp. 70-78.) 


(C7.9): Looking at the first Hilbert transform integral in (7.10.11), we see that we can 
. ve X(u) 0 X(u) *° X(u) . 
write tR(@) = —— du = ——du+] M——du. If x(t) is real then R 
_~ @-U 4 @-U 9 @-Uu 
(—®) = R() and X(—@) = — X(), and so if we make the change of variable s = — uin 


0 0° 
X(- x 
the first integral on the right we have tR() = | XS) (as) +| 28) 4 
«oo @+S 9 O-U 


--| XS as + | XO au= | x(u) [4 - L]au = | X(u) as 5 du. 
9 @+s8s 9 @-u 0 ean Ore 0 or —Uu 
That is, an alternative form for the first Hilbert transform integral in (7.10.11) is 


Xx 
R(@) = :| = u) du. Use this same approach to find an alternative form for the 
0 oO —u 


second Hilbert transform integral in (7.10.11), one that gives X(@) as an integral of R 
(@) for the case of x(t) real. 


(C7.10): Suppose x(t), y(t), and h(t) are time signals such that the following three 
conditions hold: 


(a) x(t) has finite energy: 
(b) y(t) = x(t) * h(t) = f ©, x(w)h(t — u)du; 
(c) f %,Ih(t)ldt < 00. 


Show that y(t) has finite energy. Hint: Use Fourier transforms, Rayleigh’s energy 
theorem, and a look back at the hint for (C7.3) may also help. 


(C7.11): Calculate the Hilbert transforms of cos(@ot) and sin(@ot). Hint: Use Euler’s 
identity in the defining integral (7.10.12) for the Hilbert transform of a time signal, 
and you may also find that recalling (7.9.3) is helpful. 


Chapter 8 
Contour Integration 


8.1 Prelude 


In this, the penultimate chapter of the book, I’ll give you a really fast, stripped- 
down, ‘crash-course’ presentation of the very beginnings of complex function 
theory, and the application of that theory to one of the gems of mathematics: 
contour integration and its use in doing definite integrals. As we start this chapter 
I'll assume only that you are familiar with complex numbers and their manipula- 
tion. I’ve really already done that, of course, in Chap. 7, and so I think Iam on safe 
ground here with that assumption. The first several sections will lay the theoretical 
groundwork and then, quite suddenly, you’ll see how they all come together to give 
us the beautiful and powerful technique of contour integration. None of these 
preliminary sections is very difficult, but each is absolutely essential for under- 
standing. Don’t skip them! 

In keeping with the spirit of this book, the presentation leans heavily on intuitive, 
plausible arguments and, while I don’t think I do anything wildly outrageous, there 
will admittedly be occasions where professional mathematicians might feel tiny 
stabs of pain. (Mathematicians are a pretty tough bunch, though, and they will 
survive!) This may be the appropriate place to quote the mathematician John 
Stalker (of Trinity College, Dublin), who once wrote “In mathematics, as in life, 
virtue is not always rewarded, nor vice always punished [my emphasis].”' As 
always, I’1l feel vindicated when, after doing a series of manipulations, MATLAB’s 
numerical calculations agree with whatever theoretical result we’ve just derived. 


‘In his book Complex Analysis: Fundamentals of the Classical Theory of Functions, Birkhauser 
1998, p. 120. 
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8.2 Line Integrals 


Imagine two points, A and B, in the two-dimensional x,y plane. Further, imagine 
that A and B are the two end-points of the curve C in the plane, as shown in 
Fig. 8.2.1. A is the starting end-point and B is the terminating end-point. Now, 
suppose that we divide C into n parts (or arcs), with the k-th arc having length A s, 
(where k runs from | to n). Each of these arcs has a projection on the x-axis, where 
we’ ll write Ax, as the x-axis projection of As,. In the same way, we’ll write Ay, as 
the y-axis projection of As,. Again, see Fig. 8.2.1. Finally, we’ll assume, as n — oo, 
that As, — 0, that Ax, — 0, and that Ay, — 0, for each and every k (that is, the 
points along C that divide C into n arcs are distributed, loosely speaking, ‘uni- 
formly’ along C). 

Continuing, suppose that we have some function h(x, y) that is defined at every 
point along C. If we form the two sums )°?_ ,; h(x, yeJAX, and DR_ HEX YIAY« 
where (Xx, Yx) is an arbitrary point in the arc As,, then we’ll write the limiting values 
of these sums as” 


(8.2.1) limp oo) (Xk: Yx)AXK = | h(x, y)dx = Ik 
mt Cc 


and 


Fig. 8.2.1 A curve in the plane, and its projections on the x and y axes 


? In keeping with the casual approach I’m taking in this book, I’ll just assume that these two limits 
exist and then we’ll see where that assumption takes us. Eventually we’ll arrive at a new way to do 
definite integrals (contour integration) and then we'll check our assumption by seeing if our 
theoretical calculations agree with MATLAB’s direct numerical evaluations. 
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Fig. 8.2.2. Two different v 
line integral paths 


f-->- = --> = gg 


(8.2.2) limnoo (Xk, YAY = [ nia.y) dy =I. 


The C’s at the bottom of the integral signs in (8.2.1) and (8.2.2) are there to 
indicate that we are integrating from A to B along C. We’ll call the two limits in 
(8.2.1) and (8.2.2) line integrals (sometimes the term path integral is used, com- 
monly by physicists). If A = B (that is, if C is a closed loop*) then the result is called 
a contour integral. When we encounter contour integrals it is understood that C 
never crosses itself (such a C is said to be simple). Further, it is understood that a 
contour integral is done in the counter-clockwise sense; to reverse the direction of 
integration will reverse the algebraic sign of the integral. 

The value of a line integral depends, in general, on the coordinates of A and B, 
the function h(x, y), and on the specific path C that connects A and B. For example, 
suppose that A = (0, 0), B= (1, 1), and that h(x, y) = xy. To start, let’s suppose that 
C=C, is the broken path shown in Fig. 8.2.2. The first part is along the x-axis from 
x =0 to x= 1, and then the second part is straight-up from x = 1 (y=0) to x=1 
(y= 1). So, for this path we have y =0 along the x-axis (and so h(x, y)=0), and 
x = 1 on the vertical portion of C; (and so h(x, y) = y). Thus, our two line integrals 
on this path are 


> There are, of course, two distinct ways we can have A = B. The trivial way is if C simply has zero 
length, which immediately says I, =I, =0. The non-trivial way is if C goes from A out into the 
plane, wanders around for a while, and then returns to A (which we re-label as B). It is this second 
way that gives us a closed loop. 
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1 1 


oax+ | ydx =0+0=0 
0 1 


I, = | h(x, y) dx = | 
Cc 
and 


0 1 1 1 1 
=| h(x, y y= | oay + | yay = (59°) =x. 
: Pe ) 0 0 2 0 2 


Along the path C5, on the other hand, we have y=x from A to B, and so 
h(x, y) = x? (or, equivalently, ¥): So, on this path the line integrals are 


! 1 | 
=| h(x, y)ax = | x dx = (3) =x 
CG, é 3 Jig 3 
and 
1 3\|' 
=| h(x. y)ay = | y dy = (3) ae 
Co 0 0 


Clearly, the values of the I,, I, line integrals are path-dependent and, for a given 
path, the I,, I, line integrals may or may not be equal. We can combine the I, and I, 
line integrals to write the line integral along C as Ic=1, + ily, and so Ic, = is while 
Io. =$ +8. 

Looking back at the previous section, notice that in Fig. 8.2.2 we could write the 
unbroken line segment AB as z=x+/y or, as y=X, Z=x+ix=x(1+/) and so 
dz =(1 +i) dx. Then, as h(x, y) = h(x, x)= x’, we have 


a oe 


0 hor 


Ic. = [ ?(1+i)dx =(1+2) Ga 


which is just as we calculated before. 

For now, we’ll put aside these considerations and turn to expanding this book’s 
discussion from functions of a real variable to functions of a complex variable. 
Soon, however, you'll see how this expanded view of functions will ‘circle back’— 
how appropriate!—to closed contour line integrals, and what we’ve done in this 
section will prove to be most useful. 


8.3 Functions of a Complex Variable 


I will write the complex variable z as 


(8.3.1) z=x+Ily 
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where x and y are each real with each varying over the doubly-infinite interval — oo 
to +00, and i= V-1 . Geometrically, we’ll interpret z as a point in an infinite, 
two-dimensional plane (called the complex plane) with x measured along a hori- 
zontal axis and y measured along a vertical axis. And we’ll write a complex 
function of the complex variable z as 


(8.3.2) f(z) = f(x + iy) = u(x, y) + iv(x,y) 


where u and v are each real-valued functions of the two real-valued variables x and 
y. For example, if 


f(z) =2? =(x+ iy) =x? —y? + i2xy 


then, in this case, u=x?— y- and v= 2xy. In x, y notation, we are said to be 
working in rectangular (or Cartesian) coordinates. 

It is often convenient to work in polar coordinates, which means we write the 
complex variable z as 


(8.3.3) z = re” 


where r and @ are each real: r is the radial distance from the origin of the coordinate 
system of the complex plane to the point z (and so 0 <r < oo), and 0 is the angle of 
the radius vector (of length r) measured counter-clockwise from the positive 
horizontal x-axis to the radius vector (and so we generally take 0 < 0 < 2m). Note, 
carefully, however, that 0 is not uniquely determined, as we can add (or subtract) 
any multiple of 2x from 0 and still be talking about the same point in the complex 
plane. 

From Euler’s fabulous formula (look back at Chap. 7) we have from (8.3.3) that 


(8.3.4) z =r{ cos (8) +/sin(0)}. 
For example, if f(z) = Zz then 
f(z) = (rei)? = r’{ cos (8) + isin (8)}? 
or, expanding both sides of the last equality, 
re = r°{ cos (20) + isin (26)} = r°{ cos?(8) — sin?(0) + i2 cos (8) sin (6) }. 
Since the real and imaginary parts of the expressions in the last equality must be 


separately equal, we conclude that cos(20) = cos(0) _ sin?(0) as well as sin(20) = 
2 cos(9)sin(8). These two formulas are the well-known double-angle formulas from 
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trigonometry, and so already we have a nice illustration of the powerful ability of 
complex functions to do useful work for us. 

Pll end this section with two more spectacular demonstrations of that power. 
First, the calculation of 


an integral I am absolutely sure you have never seen done by the ‘routine’ 
integration techniques of freshman calculus. We’ll do it here (using the polar 
form of z) with a contour integration in the complex plane. With z=e'°, which 
puts z is on the unit circle (r= 1) centered on the origin, we can write 


1 1 
0 =-— _— 
cos (8) 5 (z+2) 
1_ ,-i0 


because = =e ™ and Euler’s formula says this is cos(0) — i sin(®). Now, consider 
the complex function 


which we’ll integrate counter-clockwise once around the unit circle. That is, we’ll 
compute 


(ost 
} a 
Cc 


Z 


where C is the circle z=e’®. (The circle on the integral sign is there simply to 
emphasize that we are working with a closed line integral.) 

The reason for the z in the denominator of the integrand is because dz =i ed0 
and we need an e” in the denominator to cancel the e” in dz. So, 


4(z+4) 2m ,cos(0) Qn 
(8.3.5) | eae _ | € é ie da = | e008 (©) 40. 
Cc Z 0 e! 0 


That is, the contour integral at the left in (8.3.5) is the integral we are after 
multiplied by 7. To directly calculate the contour integral, we start by expanding the 
exponential in the left-most integral in a power series. That is, 


“Tf, instead, we had started with f(z) al (re!) re r{cos(8) + i sin(6)}°, then we could 
have just as easily have derived the triple-angle formulas that are not so easy to get by other means 
(just take a look at any high school trigonometry text). 
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1 1 
e 22) is. ie eae, 7 i\" 
7 7 dz = - > 4 al dz $= ae 7 (< + -) dz. 


Using the binomial theorem to write 


1 —_ n n k 1 ae n n k 1 _ n n 72k 
eae es kc} \e aes kj}? pee Lasol ke) 


we have 


Nor) 
e 1 foe) 1 n n 72k 
$ Z de= $= er 2! ys @ a dz 
ee oe 1 a n 2k—n—1 
~ ae mn! oe ( k ) - dz 
co ol m n 2k-n-1 
oy Oe ane 


Now, concentrate on that last integral, where we’ll replace z with e” and dz 
with ie'°d0: 


2n 21 wis 
9k—-n—-1 _ i9\2k—n-1. j9 3 i(2k—n)0 _ 2ni if 2k -n = 0 
f 2 a= (e”) ie o= i] “e dd = OPEB * 


This is remarkable! Every one of these integrals on the right vanishes as n and k run 
through their values except for those cases where k = 5 . This has a profound 
implication, as then k can be an integer (which of course it is) only if n is even. For 
all odd values of n the integrals vanish, and in the cases of n even they vanish, too, if 
k #5. We can include all the integrals that don’t vanish with the simple trick of 
writing n=2 m, where m=0, 1, 2, 3, ..., and so we have 


1 1 
e 2(2+2) ss i 2m is 1 (2m!) 
7 Z 2 Die 27™(2m!) ( m ) es pen 27™(2m!) m!m! 


no 1 
=~ ani 0 22m (m!)* 


From (8.3.5) we can now write 
2n 


CO 1 
: oan cos (0) 
2ti y J 2 (mij ip = i[ e do 


or, cancelling the i’s, we have our answer: 
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(8.3.6) ag eS) d9 =2n Ye _,—— 


22M (m!)2 : 


The terms in the series on the right decrease very rapidly and so the 
series quickly converges. Using just the first four terms the sum is 


2n(1 tat +=) = 7.95488 and MATLAB agrees, as quad(@(x)exp(cos 


(x)),0,2*pi) = 7.95492.... 

For the final demonstration in this section (this one from physics) of the amazing 
utility of complex functions, imagine a point mass m moving in a plane along the 
path given by (8.3.3), 


(8.3.7) z(t) = r(t)e® 


where now z, r and 6 are specifically indicated to be functions of time (t). (The 
meaning of each of these variables is as given at the beginning of this section.) The 
motion of m is due entirely to a force acting along the line connecting the mass to 
the source of the force: the classic example of this situation is the Earth (the ‘point’ 
mass) moving under the influence of the gravitational field of the Sun (which we’ll 
take as being at the origin of the x-y coordinate system). The attractive force on the 
Earth is, of course, always directed radially inward towards the Sun. 

If we write the magnitude of the force on m as f(r, 0), Newton’s famous second 
law of motion (‘force is mass times acceleration’) says 


(8.3.8) f(r, 0)e® = m—. 


From (8.3.7) we have 


and so 


dz dr, dr.dO  [drdo oy 0 » dO .d0 io 
e T e€ Tr e 
‘| at dt dt? dt’ dt 


or, 


dz |dr do\? 
(8.3.9) a (f (2) e 


Using (8.3.9) in (8.3.8) and cancelling all the el? (which are never zero), we 
arrive at 


; drdQ 6] 
| r Je" 
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f(e,9) = Pr (d0\” im|rtt % , 0 
r,6) =m r im aa real 


Equating real and imaginary parts of this last expression gives us the famous 
differential equations of motion in a radial force field: 


2 2 
(8.3.10) f(r,0) = o (5) | 


and 


drdd «0 
8.3.11 2— —4+r— =0 
Coan dt dt ae 


Interestingly, the result in (8.3.11) was implicitly known long before Newton. 
Mathematics alone tells us that 


df 240) _ 4. (dr) dO, ,d0 5 (ar) a de 
— 4p =2r|— | —4+9r- 7 = re ree leo 
dt |" at dt) dt ae® [| \dt/ dt ae 


and, since the expression in the square brackets is zero by (8.3.11), we have 


d { ,d0 


Thus, integration gives us 
(8.3.12) r—=C 


where C is a constant. This result has a historically important physical interpretation 
in the theory of planetary motion. 

Look at Fig. 8.3.1, which shows a planet’s location at times t and t+ At, with the 
Sun at the origin of our coordinate system. We assume At is so small that the 
angular change AO in the radius vector’s angle is also very small, and that the length 
of the radius vector remains essentially unchanged. Then, the area between the two 
dashed lines is essentially that of an isosceles triangle with area AA given by 


1 
rA0)r = =r’ AO. 
2 


1 1 
AA = 5 base times height ~ 5 


Dividing through by At gives 
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planet at time t + At 


— planet at time t 


do 
Fig. 8.3.1 Interpreting 1 7 


AA 1 ,A0 
At 2 At’ 


an expression that becomes exact as At — 0. That is, replacing the delta quantities 
with differential ones, we have 


dA 1 _,d0 
dt 2 dt 
or, from (8.3.12), 
Be 5 2G 
dt “dt ~~ 


This last expression is the mathematical form of the statement (given in 1609) by 
the German astronomer Johann Kepler (1671-1630) of his famous area law: the line 
joining the Sun to a planet sweeps over equal areas in equal time intervals. Kepler 
deduced this (the second of three general laws he discovered) not by physics or 
complex function theory, but rather from years of tedious observational data. 
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8.4 The Cauchy-Riemann Equations and Analytic 
Functions 


Complex function theory really starts with the study of what it means to talk of the 
derivative of f(z). In real function theory, the derivative of g(x) at x = Xo is defined 
as 


(xo + Ax) — g(Xo) 


me 2 
me = g (Xo). 


d é 
i = = limax—o 

We do almost the same thing with a complex function. Indeed, the formal 
definition for the derivative of a complex f(z) at z = Zo is 


df f Az) —f 
7{.. |Z=Zo — limaz-0 (20 ze z) (20) 
dx Az 


= f’(z0). 


The vanishing of Az = Ax + iAy is, however, not quite as straightforward as it is 
in the case of a real variable. In that simpler case, where we let Ax — 0 to calculate 
g’(Xo), Ax only has to vanish along the one-dimensional real axis. That is, Ax can 
shrink to zero in just two ways: either from the left of xp or from the right of xo. But 
in the complex case we must take into account that, since Zo is a point in the 
complex, two-dimensional plane, then Az can shrink to zero in an infinity of 
different ways (from the left of zo, from the right of Zp, from below Zo, from 
above Zp or, indeed, from any direction of the compass). So, just how does Az — 0? 

Mathematicians consider the most condition-free definition possible for the 
derivative to be the best definition, and so their answer to our question is: we 
want f’(Zo) to be the same independent of how Az — 0. To have this be the case, as 
you might suspect, comes with a price. If f=u + iv then the price for a derivative at 
Z=Zo that doesn’t depend on the precise nature of how Az— 0 is that u and v 
cannot be just any functions of x and y, but rather must satisfy certain conditions. If 
these conditions are satisfied at z= Zp and at all points in a region (domain or 
neighborhood are terms that are also used) surrounding Zo, then we say that f(z) is 
an analytic function in that region (not to be confused with the analytic signal from 
radio theory that we encountered in the previous chapter). 

The conditions for f(z) to be analytic are called the Cauchy-Riemann (C-R) 
equations, which are actually pretty easy to state: at z= Zo it must be true that 


Ou ov 
(8.4.1) 3x = ay 
and 
ao u__dy 
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For example, suppose that f(z) =z. That is, f(x,y) =x+i/y=u(x, y) +7 v(x, y) 
which means that u(x, y) = x and that v(x, y)=y. Then, 


and we see that the C-R equations are satisfied. Indeed, since the C-R equations are 
independent of z (of zo) then f(z) =z is analytic over the entire finite complex 
plane.” As a counter-example, of a f(z) that is nowhere analytic, consider 
f(z) = Z = x — iy, where Z is the conjugate of z. Then, 


and so (8.4.1) is never satisfied. 

Under not particularly harsh requirements the C-R equations are necessary and 
sufficient conditions for f(z) to be analytic, and I'll refer you to any good text 
devoted to complex function theory for a proof of this.° To show that the C-R 
equations are necessary is not at all difficult, however. Since Az = Ax+iAy then 
to have Az— 0 requires that both Ax — 0 and Ay — 0. That is, to speak of the 
derivative of f(z) at z= zp means to calculate 


' ; f(xp + Ax, yo + Ay) — f(x, 
f (zo) = limax—o, ay—0 (0 rea a (Xo Yo) 


Now, out of the infinity of ways that both Ax and Ay can vanish, let’s consider 
just two. First, assume that Ay = 0 and so Az = Ax. That is, z approaches 2g parallel 
to the x-axis. Second, assume that Ax = 0 and so Az = iAy. That is, z approaches Zo 
parallel to the y-axis. If f’(zo) is to be unique, independent of the details of how 
Az— 0, then these two particular cases must give the same result. In the first case 
we have 


f(xo + AX, yo) — f(Xo, Yo) 
Ax 


f (zo) = limaz—ax—0 


> The word finite is important: f(z) =z blows-up as |zl — oo and so f(z) is not said to be analytic at 
infinity. In fact, there is a theorem in complex function theory that says the only functions that are 
analytic over the entire complex plane, even at infinity, are constants. In those cases all four partial 
derivatives in the C-R equations are identically zero. 

® See, for example, Joseph Bak and Donald J. Newman, Complex Analysis (3 edition), Springer 
2010, pp. 35-40. While the C-R equations alone are not sufficient for analyticity, if the partial 
derivatives in them are continuous then we do have sufficiency. 
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= {u(xo + Ax, yo) +i v(Xo + Ax, yo) } — {u(Xo, Yo) +7 V(X, Yo) } 


= ear Ax 

es {u(xo + AX, yo) — u(x, Yo) } +i {v(Ko + AX, Yo) — V(Xo, Yo) } 
Ax—0 Ax 
Ou (dv 

~ Ox Ox 


And in the second case we have 


f(xo,¥o + Ay) — _f(xo, Yo) 


f (zo) = lima,—iay—+0 


iAy 
— jim tUCXor¥o + AY) +7 v(Xo. Yo + Ay) — {u(Xo, Yo) + # V(X, Yo) } 
Ay—0 iAy 
— tam Luo Yo + AY) = Uo, Yo) } +4 {v(X0. Yo + Ay) = V(X, Yo) F 
Ay—0 iAy 


Equating the real and the imaginary parts of these two expressions for f’(Zo) 
gives the C-R equations in (8.4.1) and (8.4.2). 

Analytic functions are clearly a rather special subset of all possible complex 
functions, but certain broad classes are included. They are: 


(1) Every polynomial of z is analytic; 

(2) Every sum and product of two analytic functions is analytic; 

(3) Every quotient of two analytic functions is analytic except at those values 
where the denominator function is zero; 

(4) An analytic function of an analytic function is analytic. 


So, from (1) f(z) =z” and f(z) =e” are both analytic, because in the first case 
f(z) is a polynomial and in the second case because the exponential can be expanded 
in a power Series. From (2) f(z) = ze is analytic, and from (3) f(z) = e7/(z" +1) is 
analytic except at z= +i which are called the singularities of f(z) because, at those 
values of z, f(z) blows-up.’ And finally, from (4) f(z) = e® is analytic. 


If the function f(z) is analytic everywhere in some region except for a finite number of 
singularities, mathematicians say f(z) is meromorphic in that region and I tell you this simply so 
you won’t be paralyzed by fear if you should ever come across that term. 
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In this section we’ll continue our earlier discussion of line integrals to derive what is 
called Green’s theorem.® We begin by imagining a closed path (contour) C that 
encloses a region R of the complex plane, as shown in Fig. 8.5.1. We further 
imagine that there are two real functions of the real variables x and y, P(x, y) and 
Q(x, y), defined at every point along C and in the region R (the interior of C). Then, 
Green’s theorem says that 


(8.5.1) $ {Px y) dx + Q(x, y) dy} = kes _ fe dy. 


The circle on the line integral in the left-hand side of (8.5.1) is there to 
emphasize that C is a closed, non-self-intersecting path (a simple curve traversed 
in the CCW sense, as mentioned in Sect. 8.2). R is called a simply connected region, 
which means every closed curve in R encloses only points in R. If a region is not 
simply connected then it is said to be multiply-connected: an example is a simply 
connected region that has a hole cut in it. The points ‘in the hole’ are considered to 
be in the exterior of C. 

Green’s theorem relates a contour integral along C to an area integral over the 
interior of C. For the contour of Fig. 8.5.1 it’s pretty obvious where the interior of C 
is, but in just a bit we’ll encounter contours whose interiors won’t be so obvious. 
Here’s a simple, low-level way to always locate the interior of a C: as you walk 
along C in the CCW sense, imagine you drag both hands along the ground. Your /eft 
hand will be in the interior, while your right hand will be in the exterior of C. 


Cc 


Fig. 8.5.1 A contour 
C and its interior R 


8 For the interesting history of this theorem, named after the English mathematician George Green 
(1793-1841), see my An Imaginary Tale, Princeton 2010, pp. 204-205. 
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Fig. 8.5.2. When Risa 
rectangle 


To prove Green’s theorem isn’t difficult, or at least it isn’t if we make some 
highly simplifying assumptions. These assumptions are actually not required, but to 
remove them complicates the proof. To start, our first assumption is that R is a 
rectangular patch oriented parallel to the x and y axes, as shown in Fig. 8.5.2. (I’ve 
drawn the patch totally in the first quadrant, but that’s just the way I drew it—in all 
that follows that is irrelevant.) The boundary edge of R is C=C, +C,+C3+Cu, 
which simply means that C is made of four sides. When we are done with this 
special R, I'll make some admittedly hand-waving (but plausible, too, I hope) 
arguments to try to convince you that far more complicated shapes for R are 
okay, too. 

a oP 
Starting with the \{, = By dx dy term on the right-hand side of Green’s theorem, 


we have 


oP x1 J v1 OP 
J, mee, if zee bs 


Z -| {P(x, y,) — P(x, yo) }dx = | 


Xo Xo 


Xx] Xo 


P(x, Yo)dx + | P(x, y; )dx 


xX] 


= [Pos y)dx + | P(x, y)dx. 


3 


Notice, carefully, that in the last two integrals I have dropped the subscripts on 
yo and y;, subscripts that were included in the earlier integrals. I can do that because 
the subscripts were originally there to distinguish between integrating along the 
lower edge (yo) or along the upper edge (y,) of R, and that job is now done in the 
last two integrals by writing C, (the lower edge) and C; (the upper edge) beneath 
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Yi OP 
the appropriate integral sign. Notice, too, that writing | ay = P(x, y,)— 
Yo 


P(x, yp) makes the assumption that there is no discontinuity in oP that is, the partial 
y 
derivative is continuous. 
Similar integrals with respect to x can be written for the other two edges (C2 and 


C4) as well and, since those are vertical edges, we know that everywhere along 
them dx = 0. That is, 


Xx] 


[Pes y) dx = | P(x, y)dx =0 


XI 


and 


Xo 


[Po y) dx = | P(x, y)dx = 0. 


Xo 


Since those integrals vanish we can formally add them to our C, and C; integrals 
without changing anything. So, 


{{, = seek 1 [Pes y) dx + | P(x, y) dx + [Po y) dx + | P(x, y) dx 


2 4 


= } Po. y) dx. 


0 
If you repeat all the above for the {| at dx dy term in Green’s theorem, and 
R OX 


observe dy = 0 along the horizontal edges C, and C3, you should easily see that 


0 
\{, “ dx dy = } Ox y) dy, 


and that completes the proof of Green’s theorem for our nicely oriented rectangle in 
Fig. 8.5.2. In fact, however, this proof extends rather easily to other much more 
complicated shapes for R. 

In Fig. 8.5.3, for example, you see how a semicircular disk can be constructed 
from many very thin rectangles—the thinner they each are the more of them there 
are, yes, but that’s okay; make them all each as thin as the finest onion-skin paper, if 
you like—the thinner they are the better they approximate the half-disk. If the 
boundary edge of the half-disk is denoted by C, and if the complete (all four edges) 
boundaries of the individual rectangles are denoted by C), C2, C3,..., then 
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Fig. 8.5.3. Making a 4 
half-disk out of many thin 
rectangles 


xk 


} (Pax +Qay} = | (Pax +Qdy} +| (Pax + Qay} +| {Pdx+Qdy}+--- 
Cc Cc Co C3 


because those edges of the individual rectangular boundaries that are parallel to the 
X-axis are traversed twice, once in each sense (CW and CCW), and so their 
contributions to the various line integrals on the right-hand-side of the above 
equation cancel. The only exception to this cancellation is the very bottom hori- 
zontal edge of the half-disk. 

In addition, the integrations along the individual vertical edges of the thin 
rectangles avoid cancellation and, if the rectangles are very thin then the union of 
the vertical edges is the circular portion of the half-disk boundary. So, after 
integrating around all the rectangles, we are left with nothing more than integrating 
along the bottom of the half-disk and the circular portion. You can see that, using 
this same basic idea, we can build very complicated shapes out of appropriately 
arranged rectangles and, since Green’s theorem works for each rectangle, then it 
works for all of them together and so Green’s theorem works for their composite 
(and perhaps quite complicated) region R. 


8.6 Cauchy’s First Integral Theorem? 


Well, it’s taken a bit to get to this point, but it will soon be clear it was worth the 
effort. Our basic result is easy to state: if f(z) is analytic everywhere on and inside C 
then 


° By convention, the theorem in this section is named after Cauchy who published it in 1814, but 
in a letter dated December 1811, written by the great Carl Friedrich Gauss (1777-1855) to his 
fellow German mathematician Friedrich Wilhelm Bessel (1784-1846), he states (without proof) 
the theorem we will prove here. In mathematics, alas for Gauss (as if he really needed more to add 
to his resumé), credit goes to the first to publish. 
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(8.6.1) } fede =0. 


To show this, recall (8.3.1) and (8.3.2). That is, with f(z) = u(x, y) +7 v(x, y) and 
writing dz =dx +i dy, we have 


} t(2)ae= 4 (u + iv) (dx +i dy) =4 (u dx + iu dy + iv dx — v dy) 
c Cc Cc 
or, 


(8.6.2) f (2)ae = } 


(u dx —vdy) +74 (v dx + udy). 
Cc Cc 

Now, because of Green’s theorem, the two contour integrals on the right are each 
equal to zero. To see this, consider the first integral on the right-hand side of (8.6.2), 
and look back at (8.5.1). You see that we have P(x, y) = u(x, y) and Q(x, y) = — v(x, 
y), and so the partial derivatives on the right-hand side of (8.5.1) are 


0Q Ov OP du 


Ox Ox’ dy Oy 


The C-R equation of (8.4.2), which holds here because we are assuming f(z) is 
analytic, says the integrand of the double integral in Green’s theorem is 


0Q OP ov odu_ dv Ov 
Ox dy Ox Oy Ox 


For the second integral on the right-hand side of (8.6.2) we have P(x, y) = v(x, y) 
and Q(x, y) =u, y). So now 


0Q du OP dv 
Ox Ox’ dy Oy 


and the C-R equation of (8.4.1) says the integrand of the double integral in Green’s 
theorem is 


0Q OP ou ov ov Ov __ 
Ox Oy Ox Oy Oy dy | 


0 


because, again, f(z) is analytic. So, (8.6.1) is proven. 
There is no denying that (8.6.1) looks pretty benign. But it has tremendous 
power. For example, consider the case of 
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Fig. 8.6.1 A contour that 
avoids a singularity at the 
origin 


which is analytic everywhere except at z= 0 because there f(z) blows-up. So, if we 
integrate f(z) around any C that avoids putting z= 0 in its interior, we know from 
(8.6.1) that we’ll get zero for the integral. With that in mind, consider the contour C 
shown in Fig. 8.6.1, where e > 0 and T is finite, and the two arcs are circular. In the 
notation of Fig. 8.6.1, we have 


(8.6.3) f (2)ae = |. fleae + | s@ae + | 


f(z)dz + | f(z)dz = 0. 
C3 


Cy 


For each of the four segments of C, we can write: on Cj: z= x, dz=dx; on C2: 
z=Te®, dz=iTe'd0, 0<0< 5; on C3: z=i y, dz=i dy; on Cy: z=ee™, 
dz = iee’d0, 5 > 8>0; 


Thus, (8.6.3) becomes 


joel 


T elx 5 eite” a: € elliy) ; 0 elee = 
f aor > Te iTe™ dO + es idy + eel ice dO = 0. 


£ 
2 


Then, doing all the obvious cancellations and reversing the direction of integra- 
tion on the third and fourth integrals (and, of course, their algebraic signs, too), we 


arrive at 
T Vix 5 ei baa T ,-y 
| Sax +if| (e™* — ea} - | ody =0. 
e X 0 € y 


If, in the last integral, we change the dummy variable of integration from y to x, 
we then have 
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T Aix _ a-x ze ; _ 
(8.6.3) | Sax +i | Cas = e=")ao ff 
x 0 


€ 


Now, focus on the second integral and expand its integrand with Euler’s 
formula: 


Tai a) ; i gi i i gi 
elite” _ eiee™ _ eiT{ cos (0)+isin(0)} ele{ cos (0)-+/ sin (0) } 


= e7 Fsin(®) @/Tcos(8) =, e €sin(8) qiecos(®) 


If we let T— oo and e 0 then the first term on the right goes to zero because 
lim; _, ce 7" =0 for all O< 0< 5, while the second term goes to 1 because 


lim,_.ge7®"©) = lime_.o e#° = e9 = 1 for allO < 0 < a 
Thus, (8.6.3) becomes, as T— co and e > 0, 


| oe ax + tf (-1)a0} = 
0 x 0 
or, using Euler’s formula again, 


d =0 
, - K-15 


[° cos (x) + isin (x) — e™* 1 


or, 


[° cos (x) — e* fe sin (x) ra 


e 
dx +i 
0 
Equating imaginary parts, we have 


dx = — 
0 xX 2 


[° sin (x) 1 


which we’ve already derived in (3.2.1)—and it’s certainly nice to see that our 
contour integration agrees—while equating real parts gives 


x 


(8.6.4) SESE ee 


0 x 


MATLAB agrees, too, as quad(@(x)(cos(x)-exp(-x))./x,0,1000) = 0.000826. . . 
which, while not exactly zero, is pretty small. You'll recall this integral as a special 
case of (4.3.14), derived using ‘normal’ techniques. 
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Fig. 8.6.2, Avoiding 
singularities with circular 
indents 


You can see that the ability of contour integration in the complex plane to do 
improper real integrals, integrals like [ §° and J. » depends on the proper choice 
of the contour C. At the start, C encloses a finite region of the plane, with part of C 
lying on the real axis. Then, as we let C expand so that the real axis portion expands 
to — co to on, or to 0 to ox, the other portions of C result in integrations that are, in 
some sense, “easy to do.’ 

The calculation of (8.6.4) was a pretty impressive example of this process, but 
here’s another application of Cauchy’s first integral theorem that, I think, tops 
it. Suppose a, b, and c are any real numbers (a 4 0) such that b* > 4ac. What is the 
value of the integral 


[- dx - 
_»ae+br+e 


I think you’ll be surprised by the answer. Here’s how to calculate it, starting with 
the contour integral 


d 
} f(z)ae =f : 
Cc caz2+bz+c 


where we notice that the integrand has two singularities that are both on the real 
axis, as shown in Fig. 8.6.2. That’s because of the given b? > 4ac condition, which 
says the denominator vanishes at the two real values (remember the quadratic 


formula!) of x. = —2-1 Vb? — 4ac and x; = —2+1Vb? —4ac F 


2a 
The equality b” = 4ac is the case where the two real roots have merged to form a 


double root. 

In Fig. 8.6.2 I’ve shown the singularities as being on the negative real axis, but 
they could both be on the positive real axis—just where they are depends on the 
signs of a and b. All that actually matters, however, is that the singularities are both 
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on the real axis. This means, when we select C, that we must arrange for its real axis 
portion to avoid those singularities as you’ll remember the big deal I made on that 
very point in Chap. 1 with the discussion there of the ‘sneaking up on a singularity’ 
trick. With contour integration we don’t so much ‘sneak up’ on a singularity as 
“swing around and avoid’ it, which we do with the C, and C, portions of C shown in 
Fig. 8.6.2 (and take a look back at Fig. 8.6.1, too, with its C, avoiding a singularity 
at z= 0). Those circular swings (called indents) are such as to keep the singularities 
in the exterior of C. Each indent has radius e, which we’ll eventually shrink to zero 
by taking the limit e — 0. 

So, here’s what we have, with C=C,+C,+C3+C4+Cs5+Cg,. on Cy, C3, Cs: 
Z=x, dz=dx; on Cy: z=X9 +ee dz=iee'd0, x >O>0; on C4: Z=X +ee, 
dz= iced0, at>6@>0; on Ce: z= Te”. dz = iTed0,0<O<n. 

Cauchy’s first integral theorem says 


} fede = {| ftevae + [_sle)ae + [_ftoael 


When we eventually let e— 0 and T— ov, the first three line integrals will 
combine to give us the real integral we are after. The value of that integral will 
therefore be given by 


- {| ftelae + [_ flee + [_ftoae}. 


So, let’s now calculate each of these three line integrals. 


For C3, 
0 “iO 
iee™ dO 
| f(z)dz = | ae 5 
C x a(X2 + ee)” + b(x2 + ce”) +e 
_ [ ieed0 
Ja a(x} + 2x,ee + 2c) + b(x. + ee”) + 


7 | 7 ieed0 
dee (ax3 + bx2 + c) + (2ax.e€«® + aeZe!20 + bee”’) 


Since (ax3 +bx2+c) =0 because x2 is a zero of the denominator (by definition), 
and as e* — 0 faster than e — 0, then for very small ¢ we have 


0 twat 1 

dé dé 1 

lim, H(2)de = lim | = _ = | = 
C x (2ax.+ bjee® 


e—0 


i Ti ‘ 
9 (2ax2 +b) 2ax2 +b 
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In the same way, 


1 
lim, f(z)d —1i———_. 
im, of. (z)dz i ra 
And finally, 
rT iT 40 
| f(z) = | 5 a 0 
Ce 9 aT*e?29 + bTe” +c 


and, since the integrand vanishes like 7 as T — ov, then 


| f(z)dz = 0. 


Ce 
Thus, 
| dx : 1 ie 1 
= Ti : 
_oo aX? + bx +c 2axr +b 2ax; +b 

Since 

b 1 

2ax, + b= 2a b* —4ac| +b = —Vb?* —4ac 
2a 2a 
and 


b 1 
dan) +b =2a]— P+ v= dee] +b= Vb? —4ac 


2a 2a 


we see that the two singularities cancel each other and so we have the interesting 
result 


(8.6.5) ie a Ojnal 210, bo = 4ac 


© ax2+bxt+c 


for all possible values of a, b, and c. This, I think, is not at all obvious! (In Challenge 
Problem 8.5 you are asked to do an integral that generalizes this result.) 

An immediate question that surely comes to mind now is, what happens if 
b* < 4ac ? If that’s the case the singularities of f(z) are no longer on the real axis, 
but instead have non-zero imaginary parts. We’ll come back to this question in the 
next section, where we’ll find that the integral in (8.6.5) is no longer zero under this 
new condition. 
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Cc { CE 


Fig. 8.6.3 A curious contour 


Contour indents around singularities are such a useful device that their applica- 
tion warrants another example. So, what I'll do next is use indents to derive a result 
that would be extremely difficult to get by other means: the value of 


| : dx,0<a<l. 
_«© 1-& 


To evaluate this integral, we’ll study the contour integral 


eZ 
(8.6.6) 7 ae, 
using the curious contour C shown in Fig. 8.6.3. 

The reasons for choosing this particular C (looking a bit like a block of cheese 
that mice have been nibbling on) probably require some explanation. The real-axis 
portions (C, and C3) are perhaps obvious, as eventually we’ll let T — oo, and these 
parts of C (where z = x) will give us the integral we are after. That is, the sum of the 


C, and C; integrals is 
—é ax T ax 
| <_ dx +| <_ dx, 
_p l-e& e 1—e& 


The semi-circular indent (C2) with radius e¢ (which we’ll eventually let — 0) 
around the origin is also probably obvious because z=0 is a singularity of the 
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integrand, and so you can see I’m trying to set things up to use Cauchy’s first 
integral theorem (which requires that C enclose no singularities). It’s the other 
portions of C, the two vertical sides (C4 and Cg), and the two sides parallel to the 
real axis (C5 and C7), that are probably the ones puzzling you right now. 

Since I am trying to avoid enclosing any singularities, you can understand why I 
am not using our previous approach of including a semi-circular arc from T on the 
positive real axis back to —-T on the negative real axis, an arc that then expands to 
infinity as T— oo. That won’t work here because the integrand has an infinity of 
singularities on the imaginary axis, spaced up and down at intervals of 217i (because 
Euler’s identity tells us that 1 — e* = 0 has the solutions z = 2z/k for k any integer). 
A semi-circular arc would end-up enclosing an infinite number of singularities! 

There is another issue, too. The k=O singularity is the one we’ve already 
avoided on the real-axis, but why (you might ask) are we intentionally running 
right towards the singularity for k = 1 (at 277 on the imaginary axis)? Isn’t the C in 
Fig. 8.6.3 just asking for trouble? Sure, we end-up avoiding that singularity with 
another semi-circular indent, but why not just run the top segment of C below the 
k=1 singularity and so completely and automatically miss the singularity that 
way? Well, trust me— there is a reason, soon to be revealed. 

Since we have arranged for there to be no singularities inside C we have, by 
Cauchy’s first integral theorem, 


8 eee 
— dz=0 
ile 


or, since on C; and C3 we have z= x, 


-€ ax al ax 
OY ge ee 
7 1 —e* € 1 —e* Co C4 Cs Co Cy Cg 


Soon, of course, we’ll be letting T— oo and e — 0 in these integrals. Let’s now 
start looking at the ones on the right in more detail, starting with Cy. 

On Cy, we have z= T+/y where 0 <y < 2n. The integrand of the C, integral is 
therefore 


ea ealT+iy) eal eiay 


1—-e 1—elts) 1—eTey’ 


As T — 00 we see that the magnitude of the numerator blows-up like e*" (le’*Yl = 
1), while the magnitude of the denominator blows-up like e'. So, the magnitude of 
the integrand behaves like e@~ DT as T-— co which means, since 0<a< 1, that the 
integrand goes to zero and so we conclude that the C, integral vanishes as T — oo. 
In the same way, on Cg we have z= — T+/y with 2x > y > 0. The integrand of the 
Cg integral is 
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et ea(-Ttiy) e @Teiay 


l—e 1-—el-THy) 1 —eTely 
and so as T — oo we see that the magnitude of the numerator goes to zero ase *" 
(because a is positive) while the magnitude of the denominator goes to 1. That is, 
the integrand behaves like e- *" and so the Cg integral also vanishes as T — oo. 
Next, let’s look at the C5 and C; integrals. Be alert!—this is where you'll see 
why running C right towards the imaginary axis singularity at 277 is a good idea, 
even though we are going to avoid it ‘at the very last moment’ (so to speak) with the 
C. semi-circular indent. On the Cs and C; integrals we have z=x+2zi and so 
dz = dx (just like on the C, and C; integrals). Writing-out the Cs and C7 integrals in 
detail, we have 


€ ealxt2xi) -T ea(xt2ni) E  QaX@2nai —T e2X e2nai 
Oni dx t Oni dx = 7 axe Qn dx + es a Oa x 
T 1 — ext Tl 1 = ext Tl T 1 — exe 2a 4 1 — eXe 2m 


—é 


or, because e 7” = 1 (this is the crucial observation!) we have the sum of Cs and C7 


integrals as 
T ax —e ax 
=e | © dx +| © dx]. 
1—e _pl-e& 


Notice that, to within the constant factor — e?™™, this is the sum of the C, and C; 
integrals. We have this simplifying result only because we ran the top segment of C 
directly towards the 277 singularity. All this means we can now write (8.6.7) as 
(because, don’t forget, the C4 and Cg integrals vanish as T — oo): 


— T eax —e ex 
(8.6.8) (1-e™) dx + dx} = ’ 
e 1 — e* _T 1 —e* © (on 


On C, we have z= ee”? for x >0> 0 and so dz= ice’’d0. Thus, 


id 


0 
| = | = ice d0. 
on 1 — ef 
Recalling the power series expansion of the exponential and keeping only the 


first-order terms in € (because all the higher-order terms go to zero even faster than 
does €), we have 


1—e& x1 [1 + ce” = —ee”, 


In the same way, 
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i0 y 
et” ~ 1 4+ ace” 


and so 


0 id 1 
1 . 
lim, = im | = “— iee”d0 = | dO = ni. 
ron —ee! 0 


wT 


On Ce we have z= 2mi + ee”? for 0 >0>-—n and so dz= iee’d0. Thus, 


ee) F i 
—1 e2(2nitee ) ae —X 22m gace”® 8 
Ce 0 1 —e Ti-++Ee 0 1 — ete 


or, as we let e > 0, 


pct ence” ; [cm ; 
| = ie | A ce”d0 = ~ie™| de = ime*2™ 
Ce o —€e 0 


Plugging these two results for the Cz and Cg integrals into (8.6.8) we get 


00 eax ni + ime2?2™ 1+ ea2ni eat [ea a em 

x Sis 2nai = 2nai es ati [aan —ani 

_o l-e l-e ermal — | eat [earl — earl] 
. 2.cos (az) 


Di sin (az) 


or 


O<a<l. 


~~ tan(att) ’ 


(8.6.9) 


Be sure to carefully note that the value of the integral in (8.6.9) comes entirely 
from the vanishingly small semi-circular paths around the two singularities. Sin- 
gularities, and integration paths of ‘zero’ length around them, matter! If a = i the 
integral is equal to m and MATLAB agrees because (using our old trick of ‘sneaking 
up’ on the singularity at x = 0), 

quad(@ (x)exp(x/4)./(1-exp(x)),-1000,-.0001) + quad(@ (x)exp(x/4)./U-exp 
(x)),.0001,1000) = 3.14154.... 

Before leaving this section I should tell you that not every use of Cauchy’s first 
integral theorem is the calculation of the closed-form value of an integral. Another 
quite different and very nifty application is the transformation of an integral that is 
difficult to accurately calculate numerically into another equivalent integral that is 
much easier to calculate numerically. Two examples of this are 
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ne) T 
I(a) = | CORA | B08 UB) 
0 0 


x+a x+a 
and 
OO! 3% a as 
ie | sin (x) seid Him | sin (x) 
go X+a o X+a 


where a is a positive constant. These two integrals have no closed-form values, and 
each has to be numerically evaluated for each new value of a. 

To do that, accurately, using the usual numerical integration techniques is not 
easy, for the same reasons I gave in the last chapter when we derived (7.5.2). That 
is, the integrands of both I(a) and J(a) are really not that small even for ‘large’ T, as 
the denominators increase slowly and the numerators don’t really decrease at all but 
simply oscillate endlessly between + 1. To numerically calculate I(a), for example, 
by writing guad(@(x)cos(x)./(x+a),0,T) with the numerical values of a and T 
inserted doesn’t work well. For example, if a= 1 then for the four cases of T=5, 
10, 50, and 100 we get 


1(1) 
5 0.18366... 
10 0.30130... 
50 0.33786... 
100 0.33828... 


The calculated values of I(1) are not stable out to more than a couple of decimal 
places, even for T= 100. A similar table for J(1) is 


T J) 
5 0.59977... 
10 0.70087... 
50 0.60264... 
100 0.61296... 


These values for J(1) are even more unstable than are those for I(1). 

What I’ll do now is show you how the first integral theorem can be used to get 
really excellent numerical accuracy, even with a ‘small’ value of T. What we’ll do 
is consider the contour integral 


ez 
} dz 
cZ+a 
where C=C,+C,+C; is the first quadrant circular contour shown in Fig. 8.6.4. 
The integrand has a lone singularity on the negative real axis at z= — a<0, which 


lies outside of C. Thus, we immediately know from the first theorem that, for this C, 


8.6 Cauchy’s First Integral Theorem 307 


Fig. 8.6.4 A contour that 
excludes a singularity 


(8.6.10) | <_dz =0. 


Now, for the three distinct sections of C, we have: on C;: z=x and so dz= dx, 
O0<x<T; on C;: z=Te”, dz =iTe’’d0, 0<0<4; on C3: z=i y, dz=i dy, 
T>y>0. 

So, starting at the origin and going around C in the counterclockwise sense, 
(8.6.10) becomes 


T ix t  iTe® ; 0 giliy) 
| “dx J | <—iTe®a0 + | <i dy =0 
0 Te’ +a pily+a 


or, 


[ = dx [ = dy = if ee? ga 
o X+a o yta 0 Te? +a 


Our next step is to look at what happens when we let T— oo. Using Euler’s 
formula, we have 


ete” = elf cos (8)+i sin (8) } —Tsin(0) ,/Tcos(0) 


=e e 
and so 
—i0 
eiTe" Qi T —Tsin(0) giTeos(0) 40 T(Te~® +a) 
0 a 0 =) 
Te“ +a (Te + a) (Te + a) 
: ; T? T id 
= e7 Fsin(®) @/Tcos(8) tale 


T? + aT(e® + e-®) + a? 


and so 


T? + aTe® 


308 
F Tell i T : —Tsi i 
lim |e’? el? a = lim le HSH [ener | 
T-00 Te +a T-00 
= lim jet | = 9.12 
T-00 


Thus, as T — 00 we arrive at 


lo-e) ex 
| dx 
0 X+a 


That is, 
lk ie~¥(—iy +a) 
0 


cos (x) + isin (x) sa 
| (iy + a)(—iy + a) 


X+ra 0 


or, equating real and imaginary parts, and changing the dummy variable of inte- 


gration from y to x, 


I(a) -| cos (x) ae -| xe" x 
9 xX+a 9 xX2+ a2 
and 
J(a) = | on) dx = a| ae, 
0 X+a 9 x2 +a? 


The new integrals on the right for I(a) and J(a) have integrands that decrease 


rapidly as x increases from zero. 


Calculating I(1) and J(1) again, using these alternative integrals, we have the 


following new tables: 


1(1) 
5 0.342260... . 
10 0.343373... 
50 0.343378... 
100 0.343378... 
T Jd) 
5 0.621256... 
10 0.621449. .. 
50 0.621450... 
100 0.621450... 


'° Because le'"°°* simply oscillates forever between 0 and 1, and limy_,., 


_ |" ye Y¥+iae’ 


T? + aT(e® + e-®) + a2 


d 
y? + a2 y 


T’+aTe® _ 
T?+aT(e®+e-®) +22 
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You can see from these tables the vastly improved numerical performance of our 
calculations, and we can now say with confidence that 


fe, Ua 


(8.6.11) 


f, = dx = 0.62145... 


8.7 Cauchy’s Second Integral Theorem 


When we try to apply Cauchy’s first integral theorem we may find it is not possible 
to construct a useful contour C such that a portion of it lies along the real axis and 
yet does not have a singularity in its interior. The integral of (8.6.5) for the case of 
b* < 4ac will prove to be an example of that situation, and I’ll show you some other 
examples in this section, as well. The presence of singularities inside C means that 
Cauchy’s first integral theorem no longer applies. ‘Getting around’ (pun intended!) 
this complication leads us to Cauchy’s second integral theorem: if f(z) is analytic 
everywhere on and inside C then, if Zo is inside C, 


(8.7.1) 7 £8 ay = 2ni f(Z0). 


By successively differentiating with respect to Zo under the integral sign, it can 
be shown that a// the derivatives of an analytic f(z) exist (we'll use this observation 
in the next section): 


(ny(,,) - Lf _ ft) 
f (Zo) Ini 7 (z _ zp)"t! dz, 
where zo is any point inside C and f” denotes the n-th derivative of f. 

While f(z) itself has no singularities (because it’s analytic) inside C, the inte- 
grand of (8.7.1) does have a first-order singularity'' at z= zo. Now, before I prove 
(8.7.1) let me show you a pretty application of it, so you’ll believe it will be well- 
worth your time and effort to understand the proof. What we’ll do is evaluate the 
contour integral 


" The singularity in (8.7.1) is called first-order because it appears to the first power. By extension, 
f(z) 
(z—-20)" 
in the next section. 


has a second-order singularity, and so on. I’Il say much more about high-order singularities 
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Fig. 8.7.1 A contour 
enclosing a single, first- 
order singularity 


elaz 
f. b? + 22 a 


where C is the contour shown in Fig. 8.7.1, and a and b are each a positive constant. 
When we are nearly done, we’ll let T— 00 and you’ll see we will have derived a 
famous result (one we’ve already done, in fact, in (3.1.7)), with the difference being 
that using Cauchy’s second integral theorem will be the easier of the two deriva- 
tions! Along the real axis part of C we have z = x, and along the semicircular arc we 
have z=Te”, where 0 =0 at x = T and 0=2z at x=~— T. So, 


iaz T iax T ia(Te' ; 
} van =dz =| a a+ | pr pil Teal. 
Cc Z =f x 0 Z 


The integrand of the contour integral can be written in a partial fraction expan- 
sion as 


e@laz 7 ela 7 elaz 1 1 
b?+z2 (z+ib)(z—ib)) i2b|z—ib z+ ib]’ 


and so we have 


1 eiaz elaz T lax sg eia(Te®) 3 
. | — dz | — dy =| zat | _ —___iTe®a0, 
i2b | Jcz— ib cz+ib _7p b? + x2 9 b? + Te!29 


Since the integrand of the second contour integral on the left-hand side is 
analytic everywhere inside of C—that integrand does have a singularity, yes, but 
it’s at z= — ib which is outside of C, as shown in Fig. 8.7.1—then we know from 
Cauchy’s first integral theorem that the second contour integral on the left-hand side 
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is zero. And once T > b (remember, eventually we are going to let T — oo) then the 
singularity for the remaining contour integral on the left is inside C, at z= ib. Thus, 


1 iaz — iax I ia(Te”) : 
a i= | sk + | ag Tea 
i2b Jcoz—ib _p b* + x2 0 b+ T*e!29 


The integrand of the contour integral on the left looks exactly like f(z)/(z — Zo), 
with f(z) =e” and zp = ib. Cauchy’s second integral theorem tells us that, if T > b, 
the contour integral is equal to 217 f(z), and so the left-hand side of the last 
equation is equal to 


That is, 


T iax T ia(Te”) 
e e p 1 
dx 4 —jiTe’dd =-e * ,T>b. 
i, | so b 


Now, if we at last let T— 00 then, making the same sort of argument that we did 
concerning the line integral along the circular arc in the previous section, we see 
that the second integral on the left vanishes like t . And so, using Euler’s formula, 
we have 


[- ela a [- cos (ax) 
ena — 


dx = 
oo be + x2 b ee bo +x? 


Equating imaginary parts we arrive at 


which is surely no surprise since the integrand is an odd function of x. Equating real 
parts gives us the far more interesting 


cos (ax) dx — Bene. 
_~ be +x2 b 


I haven’t put this result in a box, however, as we’ve already derived it using 
‘routine’ methods—see (3.1.7). We also did it, using the concept of the energy 
spectrum of a time signal, in Challenge Problem 7.7 (you did do that problem, 
right?). As I’ve said before, it’s good to see contour integration in agreement with 
previous analysis. 
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Fig. 8.7.2. A simple curve 
C (enclosing point zo) 
connected to an inner circle 
C* via the cross-cut ab 


Okay, here’s how to see what’s behind Cauchy’s second integral theorem. The 
proof is beautifully elegant. In Fig. 8.7.2 I have drawn the contour C and, in its 
interior, marked the point Zo . In addition, centered on Zp I’ve drawn a circle C* with 
a radius p that is sufficiently small that C* lies completely in the interior of C. Now, 
imagine that, starting on C at some arbitrary point (call it A), we begin to travel 
along C in the positive (CCW) sense until we reach point a, whereupon we then 
travel inward to point b on C*. Once at point b we travel CW (that is, in the negative 
sense) along C* until we return to point b. We then travel back out to C along the 
same path we traveled inward on until we return to point a. We then continue on 
along C in the CCW sense until we return to our starting point A. 

Here’s the first of two crucially important observations on what we’ ve just done. 
The complete path we’ve followed has always kept the annular region between C 
and C* to our left. That is, this path is the edge of a region which does not contain 
the point zo. So, in that annular region from which z= zo has been excluded by 
construction, f(z)/(z — Zp) is analytic everywhere. Thus, by Cauchy’s first integral 
theorem, since z = Zo is outside C we have 


(8.7.2) 7 A) 


,ab, —C*,ba 2 — ZO 


l 
S 


The reason for writing — C* in the path description of the contour integral is that 
we went around C* in the negative sense. 

Here’s the second of our two crucially important observations. The two trips 
along the ab-connection between C and C* (mathematicians call this two-way 
connection a cross-cut) are in opposite directions and so cancel each other. That 
means we can write (8.7.2) as 
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(8.7.3) 7 w= o-$ He) ay 7 Ee) ay, 


,-c* Z— Zo Z— Zo « Z— Zo 


The reason for the minus sign in front of the C* contour integral at the far-right 
of (8.7.3) is, again, because we went around C* in the negative sense. The two 
far-right integrals in (8.7.3) are in the positive sense, however, and so the minus 
sign has been moved from the — C* path descriptor at the bottom of the integral 
sign to the front of the integral, itself. 

Now, while C is an arbitrary simple curve enclosing Zo, C* is a circle with radius 
p centered on Zp. So, on C* we can write z=Z + pe”? (which means dz = ipe’d®) 
and, therefore, as 8 varies from 0 to 2x on our one complete trip around C*, (8.7.3) 
becomes 


f f 2m f ae id ; 2m ; 
} SE) gy = | (2) dz = | F(20 + pet) egg = | f (Zo + pe") dé. 
cZ—Zo cZ—Zo 0 pe’ 0 


If the integral on the far left is to have a value then, whatever it is must be 
independent of p. After all, the integral at the far left has no p in it! So, the integral 
on the far right must be independent of p, too, even though it does have p in it. That 
means we must be able to use any value of p we wish. So, let’s use a value for p that 
is convenient. 

In particular, let’s use a very small value, indeed one so small as to make the 
difference between f(z) and f(z), for all z on C*, as small as we like. We can do this 
because f(z) is assumed to be analytic, and so has a derivative everywhere inside C 
(including at z= zg), and so is certainly continuous there. Thus, as p — 0 we can 
argue f(z) — f(Zo) all along C* and thus 


7 3G = in f(zo)d0. 


Z— Zo 0 


Finally, pulling the constant f(zo) out of the integral, we have 


f 2n 
} AO) a= itta)| dO = 2ni f(z), 
cZ— Zo 0 


which is (8.7.1) and our proof of Cauchy’s second integral theorem is done. 
We can now do the integral in (8.6.5) for the case of b* < 4ac. That is, we’ll now 
study the contour integral 


dz 2 
} ae x 0,b < 4ac. 


The integrand of this integral has two singularities, neither of which is on the real 
axis. Since b* < 4ac these singularities are complex, and are given by 
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Fig. 8.7.3, A contour 
enclosing one of two 


singularities 
bl 
22> ma a 4ac — b” 
and 
5 te ae 
ee 2a’ ‘2a 


In Fig. 8.7.3 I’ve shown these singular points having negative real parts, but they 
could be positive, depending on the signs of a and b. It really doesn’t matter, 
however: all that matters is that with the contour C drawn in the figure only one of 
the singular points is inside C (arbitrarily selected to be z,) while the other 
singularity (Z2) is in the exterior of C. 

Now, write the integrand as a partial fraction expansion: 


1 _ 1 A B | _ 1 ” Taga f ; 7 
; : 


=— T T 
az? +bz+c ajZ—Z, Z—Z2 Z—-Z Z— Zo 


Thus, 


d 1 ac— ac— 2 
} Zz _ ae P ae ne 4 pe arr: Pa 
c c 


az?+bz+c alo 2-2 Z—Zo 


The second integral on the right is zero by Cauchy’s first integral theorem (the 
singularity z> is not enclosed by C) and so 
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} dz : 1 } dz 
= L '* 
caz?+bz+c V4ac —b? JcZ—-Z1 


From Cauchy’s second integral theorem that we just proved (with f(z) = 1) we 
have 


and so 


} dz _ 2n 
caz+bz+c  V/4ac—b? 


But, the line integral around C is 


[. dx rm i iTe® fie 
_pax?+bx+e Jo a(Te®)” +b(Te®) +c 


and the 0-integral clearly vanishes like t as T — oo. Thus, 


iC dx 21 


(8.7.4) Fa 0) Do nace 


©ax2+bx+c  V4ac—b2 


For example, if a=5, b=7, and c = 3 (notice that b* = 49 < 4ac = 4(5)(3) = 60) 
then (8.7.4) says our integral is equal tom. = 1.89445 ...and MATLAB agrees, as 
quad(@(x)1 ./(5*x.A2 + 7*x + 3),-Le5,le5) = 1.894449... . 

For a dramatic illustration of the first and second theorems, I’ll now use them to 
calculate an entire class of integrals: 


1o.¢) m 
x 
| sae 
0 x? + 1 
where m and n are any non-negative integers such that (to insure the integral exists) 
n—m-= 2. What we’ll do is study the contour integral 


(8.7.5) 7 _ 


——dz 
zm+] 


with an appropriately chosen C. The integrand in (8.7.5) has n first-order singular- 
ities, at the n n-th roots of — 1. These singular points are uniformly spaced around 
the unit circle in the complex plane. Since Euler’s formula tells us that 
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—] = ellt+2K= 


for k any integer, then these singular points are located at 


a = (-1)' = ell)", k= 0,1,2,...,0- 1. 


For other values of k, of course, these same n points simply repeat. Now, let’s 
concentrate our attention on just one of these singular points, the one for k=0. 
We'll pick C to enclose just that one singularity, at z =z) = es, as shown in 
Fig. 8.7.4. The central angle of the wedge is 2n and the singularity is at half that 
angle, *. 

As we go around C to do the integral in (8.7.5), the descriptions of the contour’s 
three portions are: on C}:z=x, dz=dx, 0<x<T; 0nC3:z= Te”, dz = iTed0, 
0<0 < 2® on C3: z = re’, dz=endr, T>r>0; 


So, 
m T m 2a i9\m 0 Mn 
n Te y rm n ;2n 
| 7 dz = | * dx 4 | u y iTed0 +| ear 
Cc m4] 0 xn 4+ 0 (Te) +1 T rei2x +1 
a m T .m i(m+1)2 2 Tel im@ ; 
= | * dx | = dr 4 | _< ie gQ, 
) x? + 1 0 rm + 1 0 T%eind + 1 


Now, clearly, as T — oo the 0-integral goes to zero because m+ 1 <n. Also, 


2n 
[' rMel(m+1)F a gion 
ae ie 0 


So, as T— 00 


Or, as 


[1 — elim VF] — gi(m+1)3 [e i(m+1)E __ elle] = —2isin { (m+ 1)=hellmens, 
n 


we have 


m 


(8.7.6) | dz = —2isin {(m+ 1) =hetimens| * dx 
cz+l n 9 x8+1 


Since 
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Fig. 8.7.4 A pie-shaped 
contour enclosing one of n 
singularities 


n—1 
2+i1= IL. (z — Zk) 


we can write the integrand of the contour integral in (8.7.5) as a partial fraction 
expansion: 


V he No N, N> N3 Nn-1 
= = + + + 2 
™M+1 Z2-Z% Z-Z Z-ZBw Z-Z Z—Zn-1 


where the N’s are constants. Integrating this expansion term-by-term, we get 


te d 
$ de = Nop 
cu+1 cZ—Zo 


since Cauchy’s first integral theorem says all the other integrals are zero because, by 
construction, C does not enclose the singularities z,, Zo, ..., Z,—1. The only 
singularity C encloses is zo. Cauchy’s second integral theorem in (8.7.1), with f 
(z) = 1, says that the integral on the right is 27/7, and so (8.7.6) becomes 


(8.7.7) ~2isin {(m +1) “hemes | =i = 2niNp. 
0 


Our next (and final) step is to calculate No. To do that, multiply through the 
partial fraction expansion of the integrand in (8.7.5) by z — Zo to get 
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Z—Zo)N 
(2=70)N3 


(z = Zo)N2 
Z— 23 


318 
_ (Z=20)Ni %. 
Z— Z2 


(Z—Z)Z™ No 


m+] 


Z—Z\ 
and then let z — Zo. This causes all the terms on the right after the first to vanish, and 


m+l _ Zoz™ 0 


so 
Nei (eee 
0 = UM 7-42 m4] = HM 7-29 z+] ~ O° 
So, to resolve this indeterminacy, we’ll use L’H6pital’s rule: 
ea (m+ 1)z™— mzoz™" i: mz™ + z™—mzz™! — zp™™t! 
o = hm Z—19 ng! = hm Z—Z0 nz! = n 
or, with zp = en, 
ei(m—nt1) gM -int® — g—ingi(™)a ei(@)= 
No = = — = 
n n n n 
Inserting this result into (8.7.7), 
(mp) 
CO x™ nif ~ n 
| xm has ~ —2i sin {(m + 1) Zhe(™ Dn’ 
0 n 


and so we have the beautiful result 


(8.7.8) 

For a specific example, you can confirm that m=0 and n=4 reproduces our 
result in (2.3.4). As a new result, if m=0 and n=3 then (8.7.8) says that 
1.209199... and MATLAB agrees: 


r 


dx 3 2n 


sin {3} 33 


| x41 2 
quad(@(x)1./(x.43 + 1),0,1000) = 1.209199... . 
The result of (8.7.8) can be put into at least three alternative forms that com- 


igor 
$ 


monly appear in the math literature. First, define t= x" and so 
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dt 
dx 


n—1 


which means 


Thus, (8.7.8) becomes 


ie Oi fo@ \_ 3 =1[" Car 
o t+ laa a) sin{(m+1)F} 0 nJo ttl 


or, 
06 t monet oe (t) +1 —1 
| fe =| dt 
9 t+l sinf(m+1)#} Jo t+l1 
Now, define 
—m+l 
a 


which says . 


TT 


(8.7.9) (Uae 


> sin(att) 


For example, if a = } then 


| dx =e 
0 VvVx(x+1) sin) 


and MATLAB agrees as quad(@(x)1./(sqrt(x).*(x + 1)),0,1e10) = 3.141546... . 
Another way to reformulate (8.7.8) is to start with (8.7.9) and define t= In(x), 
and so 


!? The limits on a are because, first, since n — m > 2 it follows that m+ 1<n-—1andsoa< 1. Also, 
for x <1 the integrand in (8.7.9) behaves as x*~ ' which integrates to os and this blows-up at the 
lower limit of integration if a <0. So, 0 <a. 
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dt 1 1 
dx x et 
Thus, (8.7.9) becomes (because x = 0 means t = — co) 


ree) t(a—1) lee) at 
| : e‘dt = | Sat 
_«o l+e _« l+et 


That is, 
(8.7.10) = dx = —"— 0 <a =< I. 
sin(aTt) 
. = 1 . 1 = 1 
For example, if a= the integral equals soe SG [25-3 OT. and 


MATLAB agrees as quad(@(x)exp(x/3)./U + exp(x)),-100,100) = 3.62760... . It’s 
interesting to compare (8.7.10) with (8.6.9). 
And finally, in (8.7.9) make the change of variable 


and so 


co dx Tt 
Jo (1+x)x? _ sin(am)’ O<a<1. 


Ill end this section with an example of the use of Cauchy’s second integral 
theorem in a problem where multiple singularities of first-order appear. For the 
arbitrary positive constant a, we’ll calculate the value of 
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[ do 
9 at sin2(0) 


We can handle the multiple singularities by simply using the cross-cut idea from 
earlier in this section. That is, as we travel around a contour C, just move inward 
along a cross-cut to the first singularity and then travel around it on a tiny circle with 
radius p and then back out along the cross-cut to C. Then, after traveling a bit more 
on C do the same thing with a new cross-cut to the second singularity. And so on, 
for all the rest of the singularities. (“Tiny’ means pick p small enough that none of 
the singularity circles intersect, and that all are always inside C.) For each singu- 
larity we’ll pick-up a value of 277 f(zo), where the integrand of the contour integral 

f(z 
ea) . 
So, what contour integral will we be studying? On the unit circle C we have 


we are studying is 


; 1 5 
(8.7.12) z =e" = cos (0) + isin(@),- =e = cos (0) — isin (0) 
Z 


and so 


dz = ie” dO = iz dO 


as well as 
1 2 
5 -1 
sin(0)=z —H <s - 
2i 2zi 
Thus, 
2 2 
2 (z* — 1) 
0) =—- 
sin “(0) re 
and so the contour integral we’ll study is 
dz 
= z dz 
8.7.13 42 =4i : 
fe a i} ae mar 


The integrand clearly has four first-order singularities, all located on the real 
axis at: 


z= +v/u,u = (14 2a) + 2,/a(a + 1) 


and 
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z= +/u,u = (1 + 2a) — 2,/a(at 1). 


By inspection it is seen that for the first pair of singularities |zl > 1 and so both lie 
outside C, while for the second pair |zl < 1 and so both lie inside C. Specifically, 
let’s write z, and z, as the inside singularities where 


m1 = (1 +2a) -2 a(a+ 1) 


and 


a = —/ (1 +2a) -2 a(a+ 1) = —z,, 


while z3 and z, are the outside singularities where 


Z3 = va + 2a) + 2V/a(a+ 1) 


and 


Z4 = ~/a + 2a) + 2,/a(a+ 1) = —z3. 


The integrand of the contour integral on the right in (8.7.13) is 


Z Z 


(z— 2z)(Z — Z)(z—23)(z—2Z4) (z—2Z1)(Z — Z2)(z — z3)(Z +23) 


So, from Cauchy’s second integral theorem, the contour integral is equal to 


Z 


Z 
2ni Z=Z 
- F ae a 


(z — z1)(z2 — 232) len : 


+ 


I'll let you verify the algebra (which really isn’t awful, if you’re careful) which 
shows that each of the two terms in the square brackets is -——. Thus, 


8\/a(a+1) 


| z dz _ Ti 
czt—2(2+4a)+1 2,/a(a+1) 


and so, from (8.7.13), we multiply by 4:7 to get 
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27 


(8.7.14) a 


a+ sin2(0) = Ja(at+1)’ 


If a=3 this is 1.81379936. .., and MATLAB agrees because 
quad(@(x)1./(3 + (sin(x).42)),0,2*pi) = 1.81379936.... 


8.8 Singularities and the Residue Theorem 


In this section we’ll derive the wonderful residue theorem, which will reduce what 
appear to be astoundingly difficult definite integrals to ones being simply of 
‘routine’ status. We start with a f(z) that is analytic everywhere in some region 
R in the complex plane except at the point z= zp which is a singularity of order 
m > 1. That is, 


g(z) 

8.8.1 f(z) = —— 
(8.8.1) @=— Fs 
where g(z) is analytic throughout R. Because g(z) is analytic we know it is ‘well- 
behaved,’ which is math-lingo for ‘all the derivatives of g(z) exist.’ (Take a look 
back at (8.7.1) and the comment that follows it.) That means g(z) has a Taylor series 
expansion about z= Zo and so we can write 


(8.8.2) g(z) = cy + cy(z — 2p) + ¢2(z — 29) + €3(z — Zo)? +... 


Putting (8.8.2) into (8.8.1) gives 


Co Cy) C2 
f(z) = + + + ..4Cm + Cm41(Z — Zo 
( ) (z —_ Zo)" (z _ ~) (z = ia i me ( ) 


+ Cm4i(%— 29)" + 


or, as it is usually written, 


(8.8.3) f(z) = S>  an(z— zo)" + aay 


— 20)" 


where in the second sum all the b, = 0 for n>m. 

The series expansion in (8.8.3) of f(z), an expansion about a singular point that 
involves both positive and negative powers of (z — Zo), is called the Laurent series 
of f(z), named after the French mathematician Pierre Alphonse Laurent (1813- 
1854) who developed it in 1843. (In books dealing with complex analysis in far 
more detail than I am doing here, it is shown that the Laurent series expansion is 
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unique.) We can find formulas for the a, and b, coefficients in (8.8.3) as follows. 


Begin by observing that if k is any integer (negative, zero, or positive), then if Cis a 
circle of radius p centered on z) (which means that on C we have z = Zo + pe’), then 


2m 2m 
} (z _ z)*dz = | pxe™ ine dd —_ io] el(k+ 8 gg 
Cc 0 0 


_ ight! ei(k+1)0 me px! {iene} ra 
i(k+1)J'° k+1 O° 


As long as k# — | this last expression is 0. If, on the other hand, k= — 1 our 
expression becomes the indeterminate Q . To get around that, for k= — 1 simply 
back-up a couple of steps and write 


20 2m 
1 ; 
| (z — z) ‘dz = | a ipe'’d0 = i dO = 2ni. 
c 0 pe 0 


That is, for k any integer, 
(8.8.4) } (z — z)Kdz = 
Cc 


So, to find a particular a-coefficient (say, aj), simply divide through (8.8.3) by 
(z— ey and integrate term-by-term. All of the integrals will vanish because 
of (8.8.4) with a single exception: 


f(z) aj ‘ 
oF dz = = = 2nia;. 
c (Z— Zo) cZ—Zo 


That is, 


1 f(z) 


dz, j=0,1,2,3,.... 


And to find a particular b-coefficient (say, b;), simply multiply by (z — Zo) | 
through (8.8.3) and integrate term-by-term. All of the integrals will vanish because 
of (8.8.4) with a single exception: 


} £(2)(2.—29)"'da = f by(2— 29) tae = 4 1_ dz = 2nib;. 
c Cc C4240 


That is, 
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(8.8.6) b= x4 (2) d j= 1,2,3 
OO. j > Z ene 
1 ni c(Z—%) —— 2 — 


One of the true miracles of contour integration is that, of the potentially infinite 
number of coefficients given by the formulas (8.8.5) and (8.8.6), only one will be of 
interest to us. That chosen one is b; and here’s why. If we set j = 1 in (8.8.6) then!* 


(8.8.7) f f(2)ae = 2nib), 


which is almost precisely (to within a factor of 2mi) the ultimate quest of our 
calculations, the determination of 


f f(z) 


But of course we don’t do the integral to find b, (if we could directly do the 
integral, who cares about b,?!), but rather we reverse the process and calculate b, 
by some means other than integration and then use that result in (8.8.7) to find the 
integral. The value of b, is called the residue of f(z) at the singularity z= zo. 

What does ‘some means other than integration’ mean? As it turns out, it is not at 
all difficult to get our hands on b,. Let’s suppose (as we did at the start of this 
section) that f(z) has a singularity of order m. That is, writing-out (8.8.3) in just a bit 
more detail, 


b b bn 
f(z) =-+-+a,(z— 29) + a9 4 : + ; ste = 
Z—Z (z—2) (z — Zo) 
So, multiplying through by (z — zo)™ gives 
(z — zp) ™£(z) = +++ +.ay(z— 29)" + ap(z — z)™ + bi (z—z)™ * 


t bo(z a)? --++ Dm. 


Next, differentiate with respect to z a total of m — 1 times. That has three effects: 
(1) all the a-coefficient terms will retain a factor of (z—Z ) to at least the first 
power; (2) the b; term will be multiplied by (m—1)!, but will have no factor 
involving (z — Zo); and (3) all the other b-coefficient terms will be differentiated to 
zero. Thus, if we then let z — zp the a-coefficient terms will vanish and we’ ll be left 
with nothing but (m — 1)! b,. Therefore, 


'3 The contour C in (8.8.7) has been a circle of radius p up to this point, but in fact by using the 
cross-cut idea of Figure 8.7.2 we can think of C as being any contour enclosing Zo such that f(z) is 
everywhere analytic on and within C (except at Zo, of course). 


326 8 Contour Integration 


m-1 


aaa b= Gn Dla da 


{(Z — Z)F(z)} 


where Zo is a m-order singularity of f(z). This is so important a result that ve put 
(8.8.8) in a box. 
For a first-order singularity (m= 1) the formula in (8.8.8) reduces, with the 


interpretation of — = 1lifm=l1,to 


b; = lim (z — zo)f(z). 


Z—7Z9 


Alternatively, write 


where, as before, g(z) is analytic at the singularity z = Zp (which is then, of course, a 
first-order zero of h(z)). That is, 


h(Zo) = 0. 
Then, 
_ (z) |. g(z) 
fig (2 — OE(@) = Tite — 20) cay = 28, Re)=ha) 


Z—Zo 


where the denominator on the far-right follows because h(z) = h(z) — h(zg) because 
h(Zp) = 0. So, 


; 8(Zo) 
lim (z — zo)f(z) = —=——_.. 
on Th2) jon 


That is, the residue for a first-order singularity at z= Zo in the integrand f(z) 


= na can be computed as 


(8.8.9) 


I'll show you an example of the use of (8.8.9) in the next section of this chapter. 


8.8 Singularities and the Residue Theorem 327 


Sometimes you can use other ‘tricks’ to get the residue of a singularity. Here’s 
one that directly uses the Laurent series without requiring any differentiation at all. 
Let’s calculate 


2m 
| cos *(0)d0 
0 


for k an even positive integer. (The integral is, of course, zero for k an odd integer 
because the cosine is symmetrical about the 6-axis over the interval 0 to 2x and so 
bounds zero area.) Using (8.7.12) again, on the unit circle C we have 


and dz= iz d0. So, let’s study the contour integral 


2+1\"dz 1 (2+1) 
8.8.10 = dz. 
( ) f. ( 2z ) iz f. ger 


Here we have a singularity at z=O0 of order m=k+1. That can be a Jot of 
differentiations, using (8.8.8), if k is a large number! 

A better way to get the residue of this high-order singularity is to use the 
binomial theorem to expand the integrand as 


ot age (Heron =E(f 


j=0 


which is a series expansion in negative and positive powers of z around the singular 
point at zero. It must be, that is, the Laurent expansion of the integrand (remember, 
such expansions are unique) from which we can literally read off the residue (the 
coefficient of the z ' term). Setting 2; —k — 1 =— 1, we find that j = ‘ and so the 
residue is 


Thus, 


and so, from (8.8.10), 
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(8.8.11) ce cos*(@)d@ = a. k even. 


(2) 


For example, if k= 18 the integral is equal to 1.16534603 and MATLAB agrees 
because 

quad(@(x)cos(x).418,0,2*pi) = 1.165347... . 

Next, let’s do an example using (8.8.8). In (3.4.8) we derived the result (where a 
and b are each a positive constant, with a > b) 


‘s 1 1 
Sea ene, ee 
| a + bcos(6) a2 — be’ 


which is equivalent to 


[ lag 28 
9 a+ bcos(6) Va —b2 


because cos(0) from xz to 2x simply runs through the same values it does from 0 to z. 
Now, suppose we set a= | and write b=k < 1. Then (3.4.8) says 


ik ee ees 
o 1+kcos(0) V7 — 2’ , 


This result might prompt one to ‘up the ante’ and ask for the value of 


2m 1 
| —_________d0 =? 
o {1+ kcos(@)} 


If we take C to be the unit circle centered on the origin, then on C we have as in 
the previous section that z= e”” and so, from Euler’s identity, we can write 


1 1 241 
cos (8) = (z+ )-" ; 


So, on C we have 


ee 
1+ kcos(®) 1 +k(S+) Oz tke +k 


and therefore 
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1 4 2 
{1+ kcos(6)}2 (=) (22 +22+ 1). 
Also, as before, 
dz = ie’d0 = iz dO 
and so 


dz 
dé = — 


iz~ 


All this suggests that we consider the contour integral 


} (3) 2 # + (3) Zz 
c \k (22 +2241) iz i \k c (22 +224 1)°dz, 


We see that the integrand has two singularities, and that each is second-order. 
That is, m= 2 and the singularities are at 


(4 4 ‘ sla VilS i 


k 


Since k < | the singularity at 


-l-vV1—-kK 
k 


Z= Zoi = 


is outside C, while the singularity at 


-1+V1-k 
£= 10) = —— 
k 
is inside C. That is, Zo2 is the only singularity for which we need to compute the 
residue as given by (8.8.8). 
So, with m = 2, that residue is 


1 d 2 Z 
b; = —lim,..,,, (Z — Zo2) : 
1! 3 (22 +2241) 


Since 
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( 7 7 ( % vA Z 
Z— Zo2 = (Z— Zo2 = 

(227 +224 ing (z — z1)°(z — 202)" (z—m1)° 

Z 
ay ete areal 
14/1-k 
(+e) 

we have 


Z 


d (z " Z _ d [a Te) 
a 02 Gata. 1? ~ az (+ ye) 


which, after just a bit of algebra that I'l] let you confirm, reduces to 


raped 1-k° 
\3 
1+ V1-k 
€ oe ) 
Then, finally, we let z — Zo. = Bails 7 Ink and so 
. 1- ine ms I+ fale 2 kK 
a a= 3? 3/2 
VI ub VER 8(1-k’) A= k* 
( k + k ) KB ( ) 
Thus, 
2 2 
k 
| - ydz = 2ni 3/2 = 3/2 
c(22+2z+ 1) 4(1—k’) 2(1—k’) 
and so 


That is, 


8.9 Integrals with Multi-valued Integrands 331 


(8.8.12) 


27 
Jo {1 + kcos(@)}? d8 = (4 — k2)3/2 


For example, if k =3 then our result is 9.67359..., and MATLAB agrees 
because 

quad(@(x)1./U + 0.5*cos(x)).42,0,2*pi) = 9.67359... . 

To finish this section, I'll now formally state what we’ve been doing all through 
it: if f(z) is analytic on and inside contour C with the exception of N singularities, 
and if R; is the residue of the j-th singularity, then 


(8.8.13) § f(z) dz = 2ni Yj 1R, . 


This is the famous residue theorem. For each singularity we’ll pick-up a contri- 
bution to the integral of 277 times the residue of that singularity, with the residue 
calculated according to (8.8.8), or (8.8.9) if m= 1, using the value of m that goes 
with each singularity. That’s it! In the next (and final) section of this chapter Pll 
show you an example of (8.8.13) applied to an integral that has one additional 
complication we haven’t yet encountered. 
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All of the wonderful power of contour integration comes from the theorems that tell 
us what happens when we travel once around a closed path in the complex plane. 
The theorems apply only for paths that are closed. I emphasize this point—partic- 
ularly the word closed—because there is a subtle way in which closure can fail, so 
subtle in fact that it is all too easy to miss. Recognizing the problem, and then 
understanding the way to get around it, leads to the important concepts of branch 
cuts and branch points in the complex plane. 

There are numerous examples that one could give of how false closed paths can 
occur, but the classic one involves integrands containing the logarithmic function. 
Writing the complex variable as we did in (8.3.3) as z= re’’, we have log(z) = In 
(z) = In(re”’) 

= In(r) + 10,0 < 0 < 2m. Notice, carefully, the < sign to the left of 6 but that it is 
the strict < sign on the right. As was pointed out in Sect. 8.3, 6 is not uniquely 
determined, as we can add (or subtract) any multiple of 2x from 0 and still 
seemingly be talking about the same physical point in the complex plane. That is, 
we should really write log(z) =In(r) +7(0 + 2mn),0 <0 < 22,n=0,1,2,... . The 
logarithmic function is said to be multi-valued as we loop endlessly around the 
origin. The mathematical problem we run into with this more complete formulation 
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of the logarithmic function is that it is not continuous on any path that crosses the 
positive real axis! Here’s why. 

Consider a point z = Zp on the positive real axis. At that point, r= xo and 0 =0. 
But the imaginary part of log(z) is not a continuous function of z at Xo because its 
value, in all tiny neighborhoods ‘just below’ the positive real axis at Xo, is arbitrarily 
near 2x, not 0. The crucial implication of this failure of continuity is that the 
derivative of log(z) fails to exist as we cross the positive real axis, which means 
analyticity fails there, too. And that means all our wonderful integral theorems are 
out the window! 

What is happening, geometrically, as we travel around what seems to be a closed 
circular path (starting at Xp and then winding around the origin) is that we do not 
return to the starting point Xo. Rather, we cross the positive real axis we enter a new 
branch of the log function. An everyday example of this occurs when you travel 
along a spiral path in a multi-level garage looking for a parking space and move 
from one level (branch) to the next level (another branch) of the garage. '* Your 
spiral path ‘looks closed’ to an observer on the roof looking downward (just like 
you looking down on your math paper as you draw what seems to be a closed 
contour in a flat complex plane), but your parking garage trajectory is not closed. 
And neither is that apparently ‘closed’ contour. There is no problem for your car 
with this, of course, but it seems to be a fatal problem for our integral theorems. 

Or, perhaps not. Remember the old saying: “If your head hurts because you’re 
banging it on the wall, then stop banging your head on the wall!” We have the same 
situation here: “If crossing the positive real axis blows-up the integral theorems, 
well then, don’t cross the positive real axis.” What we need to do here, when 
constructing a contour involving the logarithmic function, is to simply avoid 
crossing the positive real axis. What we do is label the positive real axis, from 
the origin out to plus-infinity, as a so-called branch cut (the end-points of the cut, 
x = 0 and x = +00, are called branch points), and then avoid crossing that line. Any 
contour that we draw satisfying this restriction is absolutely guaranteed to be closed 
(that is, to always remain on a single branch) and thus our integral theorems remain 
valid. 

Another commonly encountered multi-valued function that presents the same 
problem is the fractional power z? =1"e'P®, where — 1 <p <1 and, as before, we 
take 0 <0 < 2x. Suppose, for example, we have the function \/z and so p = 5 . Any 
point on the positive real axis has 0 = 0, but in a tiny neighborhood ‘just below’ the 
positive real axis the angle of z is arbitrarily near to 2x and so the angle of \/z is 


= = «. That is, on the positive real axis the function value at a point is \/r while an 


'4 Rach of these branches exists for each new interval of 0 of width 2x, with each branch lying on 
what is called a Riemann surface. The logarithmic function has an infinite number of branches, and 
so an infinite number of Riemann surfaces. The surface for 0 < 0 < 2m is what we observe as the 
usual complex plane (the entry level of our parking garage). The concept of the Riemann surface is 
avery deep one, and my comments here are meant only to give you an ‘elementary geometric feel’ 
for it. 
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arbitrarily tiny downward shift of the point into the fourth quadrant gives a function 
value of \/re’* = —,/r. The function value is not continuous across the positive real 
axis. The solution for handling z? is, again, to define the positive real axis as a 
branch cut and to avoid using a contour C that crosses that cut. 

The fact that I’ve taken 0 <6 < 2z is the reason the branch cut is along the 
positive real axis. If, instead, ’'d taken —2<0<z we would have run into the 
failure of continuity problem as we crossed the negative real axis, and in that case 
we would simply make the negative real axis the branch cut and avoid any C 
crossing it. In both cases z=0 would be the branch point. Indeed, in the examples 
I’ve discussed here we could pick any direction we wish, starting at z=0, draw a 
straight from there out to infinity, and call that our branch cut. 

Let’s see how this all works. For the final calculation of this chapter, using these 
ideas, I’ll evaluate 


0] 
(8.9.1) | a) 5dx,a >0,b>0, 


o (x+a)>+b 


where a and b are constants. We’ve already done two special cases of (8.9.1). In 
(1.5.1), for a=0 and b= 1, we found that 


°° In(x) 
d = 
j ae aa 


and in (2.1.3) we generalized this just a bit to the case of arbitrary b: 


°° In(x) 1 
ca by, GOO. 
| a 


In (8.9.1) we’ll now allow a, too, to have any non-negative value. The contour C 
we’ ll use is shown in Fig. 8.9.1, which you’Il notice avoids crossing the branch cut 
(the positive real axis), as well as circling around the branch point at the origin. This 
insures that C lies entirely on a single branch of the logarithmic function, and so C is 
truly closed. 

The contour C consists of four parts, where p and R are the radii of the small 
(C4) and large (C2) circular portions, respectively, and € is a small positive angle: on 
Ci: z=re’, dz=e"dr, p<r<R; on Cy: z=Re”, dz =iRe’d0, e <0 <2x—€; on 
C3: z=relO™—9, dz=e'O"™- dr, R>r>p; on Cy z=pe”, dz=ipe'de, 
2n—e>O>e. 

We will, eventually, let p - 0,R — co, ande— 0. 

Notice, carefully, that for C3 I have avoided continuing the expressions for z and 
dz beyond their e“?*~ © factors. That is, I did not give-in to the temptation to write 
efPr— ©) — gti — @~ © (replacing e'”* with 1, from Euler’s identity). That would 
be in error because then we would be working with the negative angle —e, which 
would put us on a new branch of the logarithmic function (to use the parking garage 
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Fig. 8.9.1 A closed a 
contour that avoids crossing 
a branch cut 


branch cut 


metaphor, on the level below the entry level). To work with e~ “ would result in C 
not being a closed contour, and that would doom our analysis to failure. 
Our integrand will be 


2 
e rie) - {0 
(z+a) +b? 

and you are almost surely wondering why the numerator is In(z) squared? Why not 
just In(z)? The quick answer is that the C, and C3 integrals are in opposite directions 
as € — 0, and so would cancel each other if we just use In(z). This isn’t “wrong,” but 
it won’t give us the integral we are after. Using In*(z) avoids the cancellation, and 
I'll point that out when our analysis gets to where the cancellation would otherwise 
occur. 

The integrand has three singularities: one at z=0O where the numerator blows- 
up, and two at z= —a+ib where the denominator vanishes. Only the last two are 
inside C as p and € each go to zero, and as R goes to infinity, and each is first-order. 
From the residue theorem, (8.8.13), we have 


x2 
f A) dz = ani) 1 Rj 


where R, is the residue of the singularity at z= — a+ ib and R; is the residue of the 
singularity at z= —a—ib. As we showed in (8.8.9), the residue of a first-order 
singularity at z= Zo in the integrand function 


335 
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is given by 


For our problem, 


and 
h(z) = (z+a)° +b’. 
Since 
es altars 
then, as 
2(—a + ib +a) = i2b 
and 
2(—a — ib +a) = —i2b, 
we have 
p, = Lin(ca + yy 
i2b 
and 


. 2 
eee 


Since a and b are both non-negative, the — a+ib singularity is in the second 
quadrant, and the — a — ib singularity is in the third quadrant. In polar form, then, 


the second quadrant singularity is at 
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atthe s/s yee 
and the third quadrant singularity is at 


—a—ib= [42 + prei{tt tan '(2) } 


Therefore, 
fin( Var + bret OH) fin ae +b?) + ifn — tan-"(8)}] 
R, = i2b 7 on 
and 


R2 = ; = : 
—12b —i2b 


fin( Var + Beem "EV [in Jae +b) + if + tan") 


Thus, 277 times the sum of the residues is 


[in( Var +b") + ifm tan") }] [in Var +b) + if aan) 


Qmi(R, + Ro) = 2ni 
Bas) -( 2b 2b 


= 25 (nvr) fn (2) f(z +f a0} 


of Mew OF 
: -ain( Vee +) a+ tan-1(2)} + {n+ tan (8) y 


(Hm ()-(= Del OT} 
+e + 2n tan-1(2) + [tan-(#)]” 


b 


b a 


= : (4= tan (?) — 4in( v/a? +b?) tan! (2)) a se (?) E iin( v/a? +b?) . 


So, for the f(z) in (8.9.2) and the C in Fig. 8.9.1, we have 
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f A) dz = tan (2) [x —in( va? +b’) ] 


b 


(8.9.3) = ie a I . I. . le 


Based on our earlier experiences, we expect our final result is going to come 
from the C, and C; integrals because, as we let p, ¢, and R go to their limiting values 
(of 0, 0, and oo, respectively), we expect the C, and C, integrals will each vanish. 
To see that this is, indeed, the case, let’s do the C, and Cy, integrals first. For the Cz 


integral we have 
2n—-€ 
| Cy | € 


Now, as R— oo consider the expression in the left-most square-brackets in the 
integrand. The numerator blows-up like In?(R) for any given @ in the integration 
interval, while the denominator blows-up like R’. That is, the left-most square- 
brackets behave like mR) . The expression in the right-most square-brackets blows- 
up like R. Thus, the integrand behaves like 


{In(Re®) }” 


3 [iRe’”] d0. 
(Re® ta) + b? 


In’(R) a In’(R) 
RY oR 
and so the C, integral behaves like 
In?(R) 
2 
""R 
as R— oo. Now 
In?(R 
er Pa eta 
R oo 


which is, of course, indeterminate, and so let’s use L’Hospital’s rule: 


In?(R 4 In?(R 
tiese Sine 
R-0o ar R 
1 
u In(R 
= 2nlimpoo2In(R) 8 = 4alime int) = 


So, our expectation of the vanishing of the C2 integral is justified. 
Turning next to the C, integral, we have 
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€ 
I. Ik. 


As p—0O the expression in the left-most square-brackets in the integrand 
In*(p) 
a2+b2 


like p. So, the C, integral behaves like 


{In(pe®) }° 


_ LOVE 15 __| line] a0. 
(pe® + a)” +b? ee] 


behaves like while the expression in the right-most square-brackets behaves 


In*(p) 
10 2 zP 
a- +b 


as p— 0. Now, 


in? 
sat, lim p In’(p). 


lim,_.02 = 
OE DP ae Be pd 


Define u = : . Then, as p — 0 we have u — oo and so 


1 1 In? 
lim p In°(p) = lim — In? (0 ii 
p—- u—0o0 


u-coo U u u 


which we’ve just shown (in the C, integral analysis) goes to zero. So, our expec- 
tation of the vanishing of the C, integral is also justified. 
Turning our attention at last to the C, and C; integrals, we have 


ie) 2 i(2n—e€ 2 
| +| = [ tint) F  ciegr +4 [. {In(re ? )} el (2a—-£) dy 
Ci C3 


p (re® +a)? +b? R (re(2"-) + a)? +b? 


w [* Ln seg [Pind 108 = OF pong 


ie 2 a” i(2n— 2 2 
p (re +a)" +b p (ref2"-©) + a)" +b 


or, as p> 0,R— oo, ande— 0, 


Je+le=l ua |" {in(r) + i2m)}? np 


6 Gay +b? 0 (re2™ 4a)? +b? 


7 f In?(r) — {In(r) + i2m) }? fn i —i4nln(r) + 412 
Jo (ea) £6 Jo (rta)? +b? 


(Notice, carefully, how the In?(r) terms cancel in these last calculations, leaving 
just In(z) in the final expression.) Inserting these results into (8.9.3), we have 
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an’| a ian] ints) dr 
0 (r+a) +b? 


An? b 4 b 
we tan~! (2) _ i> tan !(2)in( v a? +b’). 
a a 


Equating real parts, we get 


i dx Lid (*) 
== tan '{- 
o (x+ay+b? b a 


which shouldn’t really be a surprise. Equating imaginary parts is what gives us our 
prize: 


(8.9.4) fn dx = + tan7} (°) In(va? + b2). 


(x +a)? + b2 b 


This reduces to our earlier results for particular values of a and b. To see (8.9.4) 
in action, if both a and b equal 1 (for example) then 


| ae dx =7In(v2) = 0.272198... 
o (x+1)°+1 4 


and MATLAB agrees, as quad(@(x)log(x)./(x + 1).42 + 1),0,le5) = 0.27206... . 
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(C8.1): Suppose f(z) is analytic everywhere in some region R in the complex plane, 
with an m-th order zero at z=Zq . That is, f(z) =g(z)(z—Zo)™, where g(z) is 
analytic everywhere in R. Let C be any simple, closed CCW contour in R that 
encircles Zz). Explain why 


1 [ f(z) 


Qni Jo f(z) 
(C8.2): Back in Challenge Problem C3.9 I asked you to accept that 
| sin (mx) d = (Ie 
0 xX 


x= Le) for a>0, m>0. Here you are to derive this result 
(x2 + a2) a 2 
using contour integration. Hint: Notice that since the integrand is even, 


oY 1 ee mz 
| = 5| . Use f(z) = ae Fay notice where the singularities are (this should 
0 —oo 


suggest to you the appropriate contour to integrate around) and then, at some point, 
think about taking an imaginary part. 
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(C8.3): Derive the following integration formulas: 


(a) . a *,0<a<l 
a =7-4,0<a< 1; 
9 1—2acos(0)+a2 1* 

- sin (x) 


oe cos (x) . 
| ——_~* __ dx = Ze~ cos (a and | = — Ze sin (a), 
seg tay EY ' (@) so fal oe? r . 
a>0,b> 0; 
a cos (x) a ; 
of. (x2 + a?) Gray a(S =). >b>0; 


*° cos (ax) _— a 
° I. (x? +e = 7p (lt abje™,a > 0,b > 0. 


In (a), use the approach of Sect. 8.3 to convert the integral into a contour 
integration around the unit circle. In (b), (c), and (d), use the contour in Fig. 8.7.1. 


00 xk 


(C8.4): Using the contour in Fig. 8.9.1, show that | 7 dx 
o (x?+1) 
= sees) , -1<k<3. Before doing any calculations, explain the limits on 


k. Hint: Use f(z) = ae notice that the singularities at z= +i are both second- 


5 "3 
order, and write zk = elt Wes e 


kin(z) : 


"cos (mx) cos(32) sin (= 
C8.5): Show that dx = —2 
( pe npny \_ ax? +be+c i 7 /b?—4ac 


Notice that this result contains (8.6.5) as the special case of m= 0. 


when b* > 4ac. 


1o.@) 


xP 
(C8.6): Show that i &+D(x+2) 


this is (V2 - 1)x = 1.30129..., and MATLAB agrees as quad(@(x)sqrt(x)./(x 
+ 1).*(x+2)),0,le7) = 1.300... . Use the contour in Fig. 8.9.1. 


(C8.7): In his excellent 1935 book An Introduction to the Theory of Functions of a 
Complex Variable, Edward Copson (1901-1980), who was professor of mathemat- 
ics at the University of St. Andrews in Scotland, wrote “A definite integral which 
can be evaluated by Cauchy’s method of residues can always be evaluated by other 
means, though generally not so simply.” Here’s an example of what Copson meant, 
an integral attributed to the great Cauchy himself. It is easily done with contour 
integration, but would (I think) otherwise be pretty darn tough: show that 

2° ¢°05(*) sin { sin (x)} 

0 xX 
2.69907... and quad(@(x)exp(cos(x)).*sin(sin(x))./x,0,1000) = 2.6978. .. 
Hint: Look back at how we derived (8.6.4)—in particular the contour in 
Fig. 8.6.1—and try to construct the proper f(z) to integrate on that contour. 


dx = (2? — 1) Gia — 1 <p<1.Forp=} 


dx = $(e — 1). MATLAB agrees with Cauchy, as this is 
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(C8.8): Here’s an example of an integral that Copson himself assigned as an end-of- 
chapter problem to be done by contour integration and residues, but which is 


00 x2 


actually easier to do by freshman calculus: show that | re 
co (x? + a?) 

= 3a > 0. The two singularities in the integrand are each third-order and, 

while not a really terribly difficult computation (you should do it), here’s a simpler 

and more general approach. You are to fill-in the missing details. 


log) x2 


-co (x2 + a2) (x? + b?) 
expansion, and do the resulting two easy integrals; (b) let b— a and so arrive at the 
io) 2 


(a) Start with | dx, with a#b, make a partial fraction 


value for ———, dx; (c) finally, use Feynman’s favorite trick of differen- 
2 4. g2)2 
soo (x2 + a2) 
tiating an integral to get Copson’s answer. Notice that you can now continue to 
oo x2 
differentiate endlessly to calculate | nt Ux for any n> 3 you wish. 
xo OF Fa?) 


Chapter 9 
Epilogue 


9.1 Riemann, Prime Numbers, and the Zeta Function 


Starting with the frontispiece photo, this entire book, devoted to doing Riemannian 
definite integrals, has been a continuing ode to the genius of Bernhard Riemann. He 
died far too young, of tuberculosis, at age 39. And yet, though he was just reaching 
the full power of his intellect when he left this world, you can appreciate from the 
numerous times his name has appeared here how massively productive he was. He 
left us with many brilliant results, but he also left the world of mathematics its 
greatest unsolved problem, too, a problem that has often been described as the Holy 
Grail of mathematics. It’s a problem so difficult, and so mysterious, that many 
mathematicians have seriously entertained the possibility that it can’t be solved. 
And it is replete with interesting integrals! 

This is the famous (at least in the world of mathematics) Riemann Hypothesis 
(RH), a conjecture which has so far soundly defeated, since Riemann formulated it 
in 1859, all the efforts of the greatest mathematical minds in the world (including 
his) to either prove or disprove it. Forty years after its conjecture, and with no 
solution in sight, the great German mathematician David Hilbert (we discussed his 
transform back in Chap. 7) decided to add some incentive. In 1900, at the Second 
International Congress of Mathematicians in Paris, he gave a famous talk titled 
“Mathematical Problems.” During that talk he discussed a number of problems that 
he felt represented potentially fruitful directions for future research. The problems 


included, for example, the transcendental nature (or not) of Qv?, Fermat’s Last 
Theorem (FLT), and the RH, in decreasing order of difficulty (in Hilbert’s 
estimation). 

All of Hilbert’s problems became famous overnight, and to solve one brought 
instant celebrity among fellow mathematicians. Hilbert’s own estimate of the 
difficulty of his problems was slightly askew, however, as the 2¥? issue was settled 


by 1930 (it is transcendental!), and FLT was laid to rest by the mid-1990s. The RH, 
however, the presumed ‘easiest’ of the three, has proven itself to be the toughest. 
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Hilbert eventually came to appreciate this. A well-known story in mathematical 
lore says he once remarked that, if he awoke after sleeping for 500 years, the first 
question he would ask is ‘Has the Riemann hypothesis been proven?’ The answer 
is currently still no and so, a century after Hilbert’s famous talk in Paris, the Clay 
Mathematics Institute in Cambridge, MA proposed in 2000 seven so-called “Mil- 
lennium Prize Problems,” with each to be worth a one million dollar award to its 
solver. The RH is one of those elite problems and, as I write in 2014, the one million 
dollars for its solution remains unclaimed. 

The RH is important for more than just being famous for being unsolved; there 
are numerous theorems in mathematics, all of which mathematicians believe to be 
correct, that are based on the assumed truth of the RH. If the RH is someday shown 
to be false, the existing proofs of all those theorems collapse and they will have to 
be revisited and new proofs (hopefully) found. To deeply discuss the RH is far 
beyond the level of this book, but since it involves complex numbers and functions, 
bears Riemann’s name, abounds in integrals, and is unsolved, it nonetheless seems a 
fitting topic with which to end this book. 

Our story begins, as do so many of the fascinating tales in mathematics, with an 
amazing result from Euler. In 1748 he showed that if s is real and greater than 1, and 
if we write the zeta function (see Sect. 5.3 again) 


(9.1.1) ts) = 0% eee de aids 


n=1 ns 2° 38 
then 


1 
(9.1.2) i re E 
I=! -#} 


where pj is the jth prime (p; = 2, po=3, p3=5, pa=7, and so on). That is, Euler 
showed that there is an intimate, surprising connection between C(s), a continuous 
function of s, and the primes which as integers are the very signature of 
discontinuity. 

Riemann was led to the zeta function because of Euler’s connection of it to the 
primes (he called it his “point of departure”), with the thought that studying 
C(s) would aid in his quest for a formula for (x), defined to be the number of 
primes not greater than x. m(x) is a measure of how the primes are distributed among 
the integers. It should be obvious that n(5) = 0, that (2) = 1, and that 1(6) =3, 
but perhaps it is not quite so obvious that x(10!8) = 24, 739, 954, 287, 740, 860. 


J 


' To derive (9.1.2) is not difficult, just ‘devilishly’ clever; you can find a proof in any good book 
on number theory. Or see my book, An Imaginary Tale: The Story of —1, Princeton 2010, 
pp. 150-152. 
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When Riemann started his studies of the distribution of the primes, one known 
approximation to (x) is the so-called logarithmic integral, written as 


(9.1.3) li(x) = lee 
2 


1 1 
AT OOO) 2 N08 cg, 
1i(1,000) 178 
‘ 2 
BOG DOD) Pe? cage... 
1i(100,000) 9, 630 


(100, 000,000) _ 5,761,455 _ 5 999 

1i(100, 000,000) 5,762,209. °°” 
(1,000, 000,000) _ 50,847,478 _ 5 go99 
1i(1, 000,000,000) 50,849,235. °° 


In an 1849 letter the great German mathematician C. F. Gauss, who signed-off 
on Riemann’s 1851 doctoral dissertation with a glowing endorsement, claimed to 
have known of this behavior of li(x) since 1791 or 1792, when he was just 14. With 
what is known of Gauss’ genius, there is no doubt that is true! 

Numerical calculations like those above immediately suggest the conjecture 


lim, 50 ts) = 1, 


li(x) 


which is a statement of what mathematicians call the prime number theorem. 
Although highly suggestive, such numerical calculations of course prove nothing, 
and in fact it wasn’t until 1896 that mathematical proofs of the prime number 
theorem were simultaneously and independently discovered by Charles-Joseph de 
la Vallée-Poussin (1866-1962) in Belgium and Jacques Hadamard (1865-1963) in 
France. Each man used very advanced techniques from complex function theory, 
applied to the zeta function. It was a similar quest (using the zeta function as well) 
that Riemann was on in 1859, years before either Vallée-Poussin or Hadamard had 
been born. 

Riemann’s fascination with the distribution of the primes is easy to understand. The 
primes have numerous properties which, while easy to state, are almost paradoxical. 


x 


? A slight variation is the modern li(x) = Es + 1.045... which, for x = 1,000 (for example), 


2 
MATLAB computes guad(@(x)J./log(x),2,1000) + 1.045 = 177.6. 
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For example, it has been known since Euclid that the primes are infinite in number 
and yet, if one looks at a list of consecutive primes from 2 on up to very high values, 
it is evident that they become, on average, ever less frequent. I emphasize the ‘on 
average’ because, every now and then, one does encounter consecutive odd integers 
(every prime but 2 is, of course, odd) that are both primes. Such a pair forms a twin 
prime. It is not known if the twin primes are infinite in number. Mathematicians 
believe they are, but can’t prove it. 

If one forms the sum of the reciprocals of all the positive integers then we have 
the harmonic series which, of course, diverges. That is, C(1) = oo. If you then go 
through and eliminate all terms in that sum except for the reciprocals of the primes, 
the sum sti// diverges, a result that almost always surprises when first seen demon- 
strated. (This also proves, in a way different from Euclid’s proof, that the primes are 
infinite in number.) In 1919 the Norwegian mathematician Viggo Brun (1885-— 
1975) showed that if one further eliminates from the sum all terms but the 
reciprocals of the twin primes, then the sum is finite. Indeed, the sum isn’t very 
large at all. The value, called Brun’s constant, is 


1 1 | i i. 
+. 1,90216.... 
(5+3) +(G+3) (ata) + (zy 5) + es 


The finite value of Brun’s constant does not preclude the twin primes from being 
infinite in number, however, and so that question remains open. 

Here’s another example of the curious nature of the distribution of the primes: 
for any a> | there is always at least one prime between a and 2a. And yet, for any 
a> 1 there is also always a stretch of at least a— 1 consecutive integers that is 
free of primes! This is true, no matter how large a may be. The first statement is due 
to the French mathematician Joseph Bertrand (1822-1900), whose conjecture of it 
in 1845 was proven (it’s not an ‘easy’ proof) by the Russian mathematician P. L. 
Chebyshev (1821-1894) in 1850. For the second statement, simply notice that 
every number in the consecutive sequence a!+2,a!+3,a!+4,...,a!+a is divis- 
ible and so none are prime. 

In 1837 a really remarkable result was established by Dirichlet (the same 
Dirichlet we first met in Chap. 1): if a and b are relatively prime positive integers 
(that means their greatest common factor is 1) then the arithmetic progression a, a 
+b, a+2b, a+3b,... contains an infinite number of primes. This easy-to-state 
theorem immediately gives us the not very obvious conclusion that there are 
infinitely many primes ending with 999 (as do 1,999, 100,999, and 1,000,999). 
That’s because a// the numbers in the progression (not all of which are prime) 
formed from a= 999 and b = 1,000 (which have only the factor 1 in common) end 
in 999, 

With examples like these in mind, it should now be easy to understand what 
the mathematician Pal Erdds (1913-1996) meant when he famously (at least in the 
world of mathematics) declared “It will be another million years, at least, before we 
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understand the primes.” With properties like the ones above, how could any 
mathematician, including Riemann, not be fascinated by the primes?* 

To start his work, Riemann immediately tackled a technical issue concerning the 
very definition of C(s) as given in (9.1.1), namely, the sum converges only if s > 1. 
More generally, if we extend the s in Euler’s definition of the zeta function from 
being real to being complex (that is, s=o+i t) then C(s) as given in (9.1.1) makes 
sense only if o > 1. Riemann, however, wanted to be able to treat C(s) as defined 
everywhere in the complex plane or, as he put it, he wanted a formula for 
C(s) “which remains valid for all s.” Such a formula would give the same values 
for C(s) as does (9.1.1) when o > 1, but would also give sensible values for C(s) even 
when o < |. Riemann was fabulously successful in discovering how to do that. 

He did it by discovering what is called the functional equation of the zeta 
function and, just to anticipate things a bit, here it is (we’ll derive it in the next 
section): 


(9.1.4) C(s) = 2(2m)*~! sin (Fra —s)t(1—s). 


Riemann’s functional equation is considered to be one of the gems of mathe- 
matics. Here’s how it works. What we have is 


C(s) = F(s)(1—s),F(s) = 2(2n)' sin (F) (1 — 5). 


F(s) is a well-defined function for all o. So, if we have an s with o > 1 we’ll use 
(9.1.1) to compute C(s), but if o < 0 we’ll use (9.1.4) (along with (9.1.1) to compute 
C(1 — s) because the real part of 1 —s is >1 if o <0). 

There is, of course, the remaining question of computing C(s) for the case of 
0<o<1, where s is in the so-called critical strip (a vertical band with width 
1 extending from —ioo to +i00). The functional equation doesn’t help us now, 
because if s is in the critical strip then so is 1 — s. This is actually a problem we’ve 
already solved, however, as you can see by looking back at (5.3.7), where we 
showed 


k-1 
ye SE = p- 2909. 


So, for example, right in the middle of the critical strip, on the real axis, we have 
s = 5 and so 


>The English mathematician A. E. Ingham (1900-1967) opens his book The Distribution of the 
Primes (Cambridge University Press 1932) with the comment “A problem at the very threshold of 
mathematics [my emphasis] is the question of the distribution of the primes among the integers.” 
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If we keep the first one million terms—a well-known theorem in freshman 
calculus tells us that the partial sums of an alternating series (with monotonically 


decreasing terms) converge, and the maximum error we make is less than the first 
term we neglect and so our error for the sum should be less than 10~ * —we get 


(5) x —1.459147.... 


The actual value is known to be 


1 
(5) = —1.460354.... 


This is obviously not a very efficient way (a million terms!?) to calculate c(4), 
but the point here is that (5.3.7) is correct. 

For Euler’s case of s purely real, the plots in Fig. 9.1.1 show the general behavior 
of C(s). For s > 1, C(s) smoothly decreases from + oo towards | as s increases from 
1, while for s <0 C(s) oscillates, eventually heading off to — oo as s approaches 
1 from below. Figure 9.1.1 indicates that ¢(0) = — 0.5, and in the next section I'll 
show you how to prove that ¢(0) = —} using the functional equation. Notice, too, 
that Fig. 9.1.1 hints at C(s)=0 for s a negative, even integer, another conclusion 
supported by the functional equation. 

To make that last observation crystal-clear, let’s write s=—2n, where 
n=0,1,2,3,.... Then, (9.1.4) becomes 


G (—2n) = —2-29_-@>+ OT (1 + 2n) sin (nn)G(1 + 2n) = 0 


because all of the factors on the right of the first equality are finite, for all n, 
including sin(nz) which is, of course, zero for all integer n. We must exclude the 
case of n=0, however, because then ¢(1+2n)=C(1)=o0, and this infinity is 
sufficient to overwhelm the zero of sin(0). We know this because, as stated 
above, and as will be shown in the next section, €(0) 40 but rather €(0) = —3. 
When a value of s gives C(s)=0 then we call that value of s a zero of the zeta 
function. Thus, all the even, negative integers are zeros of C(s), and because they are 
so easy to ‘compute’ they are called the trivial zeros of €(s). There are other zeros 
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c(s) vs. $ 


s 


Fig. 9.1.1 The zeta function for real s 


of 


C(s), however, which are not so easy to compute,* and where they are in the 


complex plane is what the RH is all about. 


Here is what Riemann correctly believed about the non-trivial zeros (even if he 


couldn’t prove all the following in 1859): 


BRWN eRe 


. they are infinite in number; 

. all are complex (of the form o +i t, t 40); 

. all are in the critical strip (0<o< 1); 

. they occur in pairs, symmetrically displaced around the vertical o = 5 line 


1 


(called the critical line), that is, if ;— € + it is a zero, then so is +e + it for 
some € in the interval O <e< 53 


. they are symmetrical about the real axis (t= 0), that is, if o+it is a zero then so 


is o—it (the zeros appear as conjugate pairs). 


“The methods used to compute the non-trivial zeros are far from ‘obvious’ and beyond the level of 
this book. If you are interested in looking further into how such computations are done, I can 
recommend the following four books: (1) H. M. Edwards, Riemann’s Zeta Function, Academic 
Press 1974; (2) E. C. Titchmarsh, The Theory of the Riemann Zeta-Function (2nd edition, revised 


by 


D. R. Heath-Brown), Oxford Science Publications 1986; (3) Aleksandar Ivi¢, The Riemann 


Zeta-Function, John Wiley & Sons 1985; and (4) The Riemann Hypothesis (Peter Borwein et al., 
editors), Springer 2008. 
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The RH is now easy to state: e=0. That is, all of the complex zeros are on the 
critical line and so have real part 5. More precisely, Riemann conjectured “‘it is very 
probable [my emphasis] that all the [complex zeros are on the critical line].” Since 
1859, all who have tried to prove the RH have failed, including Riemann, who 
wrote “Certainly one would wish [for a proof]; I have meanwhile temporarily put 
aside the search for [a proof] after some fleeting futile attempts, as it appears 
unnecessary for [finding a formula for m(x)].” 

There have been some impressive partial results since 1859. In 1914 it was shown 
by the Dane Harald Bohr (1887-1951) and the German Edmund Landau (1877-— 
1938) that all but an infinitesimal proportion of the complex zeros are arbitrarily close 
to the critical line (that is, they are in the ‘arbitrarily thin’ vertical strip 5 —e<o< 5 
+e for any e > 0). That same year Hardy proved that an infinity of complex zeros are 
on the critical line (this does not prove that all of the complex zeros are on the critical 
line). In 1942 it was shown by the Norwegian Atle Selberg (1917-2007) that an 
(unspecified) fraction of the zeros are on the critical line. In 1974 Selberg’s fraction 
was shown to be greater than ; by the American Norman Levinson (1912-1975), and 
then in 1989 the American J. B. Conrey showed the fraction is greater than 2, 

There is also what appears, at first glance, to be quite substantial computational 
support for the truth of the RH. Ever since Riemann himself computed the locations 
of the first three complex zeros,” the last few decades have seen that accomplishment 


so eae ae 


i 


0 05 1 1.5 2 25 3 


Magnitude of ¢(1/2 + it) 


Fig. 9.1.2 The first six non-trivial zeros of 4G; +i t) 


> Because of the symmetry properties of the complex zero locations, one only has to consider the 
case of t > 0. The value of t for a zero is called the height of the zero, and the zeros are ordered by 
increasing t (the first six zeros are shown in Fig. 9.1.2, where a zero occurs each place lE(5 +i t) | 
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vastly surpassed. In 2004, the first er? (yes, ten trillion!) zeros were shown to all be 
on the critical line. Since even a single zero off the critical line is all that is needed to 
disprove the RH, this looks pretty impressive—but mathematicians are, frankly, not 
impressed. As Ivié wrote in his book (see note 4), ““No doubt the numerical data will 
continue to accrue, but number theory is unfortunately one of the branches of 
mathematics where numerical evidence does not count for much.” 

There are, in fact, lots of historical examples in mathematics where initial, 
massive computational ‘evidence’ has prompted conjectures which later proved 
to be false. A particularly famous example involves x(x) and li(x). For all values of 
x for which x(x) and li(x) are known, (x) < li(x). Further, the difference between 
the two increases as x increases and, for ‘large’ x the difference is significant; for 
x=10'*, for example, d(x) = li(x) — a(x) © 22, 000, 000. Based on this impressive 
numerical ‘evidence’ it was commonly believed for a long time that d(x) > 0 for all 
x. Gauss believed this (as did Riemann) all his life. But it’s not true. 

In 1912, Hardy’s friend and collaborator J. E. Littlkewood (1885-1977) proved 
that there is some x for which d(x) <0. Two years later he extended his proof to 
show that as x continues to increase the sign of d(x) flips back-and-forth endlessly. 
The value of x at which the first change in sign of d(x) occurs is not known, only 
that it is very big. In 1933 the South African Stanley Skewes (1899-1988) derived a 


stupendously huge upper-bound on the value of that first x: ec mw 10'° va This has 
become famous (at least in the world of mathematics) as the first Skewes number. 
In his derivation Skewes assumed the truth of the RH, but in 1955 he dropped that 
assumption to calculate a new upper-bound for the first x at which d(x) changes 


sign: this is the second Skewes number equal to 1g" and it is, of course, much 
larger than the first one. In 2000 the upper-bound was dropped to ‘just’ 
1.39 x 10°!°. All of these numbers are far beyond anything that can be numerically 
studied on a computer, and the number of complex zeros that have been found on 
the critical line is minuscule in comparison. It is entirely possible that the first 
complex zero off the critical line (thus disproving the RH) may not occur until a 
vastly greater height is reached than has been examined so far. 

Some mathematicians have been markedly less than enthusiastic about the 
RH. Littlewood, in particular, was quite blunt, writing “I believe [the RH] to be 
false. There is no evidence for it ... One should not believe things for which there is 
no evidence ... I have discussed the matter with several people who know the 
problem in relation to electronic calculation; they are all agreed that the chance of 
finding a zero off the line in a lifetime’s calculation is millions to one against 
it. It looks then as if we may never know.”° A slightly more muted (but perhaps not 
by much) position is that of the American mathematician H. M. Edwards (born 
1936), who wrote in his classic book on the zeta function (see note 4) “Riemann 
based his hypothesis on no insights ... which are not available to us today ... and 


touches the vertical t-axis). The heights of the first six zeros are 14.134725, 21.022040, 25.010856, 
30.424878, 32.935057, and 37.586176. In addition to the first 10!° zeros, billions more zeros at 
heights as large as 10** have also all been confirmed to be on the critical line. 

° From Littlewood’s essay “The Riemann Hypothesis,” in The Scientist Speculates: An Anthology 
of Partly-Baked Ideas (I. J. Good, editor), Basic Books 1962. 
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that, on the contrary, had he known some of the facts which have since been 
discovered, he might well have been led to reconsider ... unless some basic 
cause is operating which has eluded mathematicians for 110 years [155 years 
now, as I write in 2014], occasional [complex zeros] off the [critical] line are 
altogether possible ... Riemann’s insight was stupendous, but it was not supernat- 
ural, and what seemed ‘probable’ to him in 1859 might seem less so today.” 


9.2 Deriving the Functional Equation for C(s) 


The derivation of the functional equation for C(s) that appears in Riemann’s famous 
1859 paper involves a contour integral in which a branch cut is involved. We’ve 
already been through an example of that, however, and so here Ill show you a 
different derivation (one also due to Riemann) that makes great use of results we’ve 
already derived in the book. 

We start with the integral 


OO 
| x™ le-%*dx, m>l, a>O, 
0 


d 
and make the change of variable u= ax (and so dx = oy, Thus, 
a 


OO [oe] [o.@) 

ae u\™-1 _ du 1 soe 
| xmle “ax =| (=) et — a u™ le" du. 
0 o \a a a"'so 


The right-most integral is, from (4.1.1), (m), and so 


(9.2.1) [xm tea = 


0 am 


Now, if we let 


and 
a=nn, 
then (9.2.1) becomes 
7 : T(iis) (ts 
(9.2.2) eek a?) Fae), 
0 n?n)? 72 °ns 
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Then, summing (9.2.2) over all positive integer n, we have 


1 
72 Sns 


i TGs) 
oS 4 s—1—n?ax cas 2, . 
2 — 
pas |x 4 dx ae 
0 
or, reversing the order of summation and integration on the left, 


i: Ie oo —n?ax al» 1 co «6 lg 1 
(9.2.3) | x? ae dx =n? rs)" 2 r(5s)e6) 


0 


At this point Riemann defined the function 
(9.2.4) Vea er 


and then used the identity’ 


a —n?ax 1 oe —n’?n/x 
(9.2.5) ye = yee x 


The left-hand side of (9.2.5) is (because n*>0 forn negative or positive) 


—l 559 oo a, oo 2 oo ed) 
yy en™ 41+ 5° Ss. eT™ 414+ 5° erm 
n=—00 n=1 n=! n=1 


= 2y(x) +1 


The right-hand side of (9.2.5) is (for the same reason) 
1 00 2 1 1 
— AUR ed Dy] 1>. 
om al Ca 


Thus, 


In my book Dr. Euler’s Fabulous Formula, Princeton 2011, pp. 246-253, you'll find a derivation 
of the identity paiaee ek = Jz S- em w/o TE you write «=x then (9.2.5) immediately 


n=—oo 
results. The derivation in Dr. Euler combines Fourier theory with what mathematicians call 
Poisson summation, all of which might sound impressively exotic. In fact, it is all at the level of 
nothing more than the end of freshman calculus. If you can read this book then you can easily 
follow the derivation of (9.2.5) in Dr. Euler. 
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or, solving for w(x), 


1 /l a Bi i 
(9.2.6) ve) =u(2) +5 5= nie : 


Now, putting (9.2.4) into (9.2.3) gives us 
15 1 se 15-1 
m2°T|—s|C(s)= | x2° ‘w(x)dx 
2 0 


or, breaking the integral into two parts, 


(9.2.7) roy (; ) C(s) = i x? “ty (aja | x2 hy(x)dx. 


Using (9.2.6) in the first integral on the right of (9.2.7), we have 


x dx 


0 J z 2K 2 


a8 (4 a 1 {1 1 1 


1 


The first integral on the right is easy to do (for s > 1): 


1 4s—l1 1 1 F ies fo. 
if ie a s\,* x5], * 
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r $s—1 - i $s—1 1 ‘l : 
Xx w(x a= We D2 x 


i 58> 4 xo 58-1 
+| Xx wl - ax+| Xx w(x)dx. 
X 
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Thus, 
1 1 : it ee 4 1 OO 
9.2.8 -35P = = 3 SF = d 5s—l d ; 
(9.2.8) a? (Fs)s0 wont |* v(2) x+| x?" y(x)dx 
1 


Next, in the first integral on the right in (9.2.8) make the change of variable u = ~ 
(and so dx = — a). Then, 


' aga fl 1 /4\283 du ll 
LeeG)e=[G) weap = aaa 


and therefore (9.2.8) becomes 
(9.2.9) nos. a C(s) = ss + [- {x erie ee (x)dx 
~ la ~~ s(s— 1) Ik : " : 


Well!—you might exclaim at this point, as you look at the integral in (9.2.9)— 
what do we do now? You might even feel like repeating the words that Oliver Hardy 
often directed towards Stan Laurel, after the two old-time movie comedians had 
stumbled into one of their idiotic jams: “Look at what a fine mess you’ve gotten us 
into this time!” 

In fact, however, we are not in a mess, and all we need do is notice, as did 
Riemann, that the right-hand side of (9.2.9) is unchanged if we replace every 
occurrence of s with 1—s. Try it and see. But that means we can do the same 
thing on the left-hand side of (9.2.9) because, after all, (9.2.9) is an equality. That is, 
it must be true that 


(9.2.10) ae (5 sets) =n? mr? “ec —s). 


We are now almost done, with just a few more ‘routine’ steps to go to get the 
form of the functional equation for C(s) that I gave you in (9.1.4). 
Solving (9.2.10) for C(s), we have 


(9.2.11) C(s) = me 601 3): 


Now, recall (4.2.18), one of the forms of Legendre’s duplication formula: 


1 
z! € — 5)! - 2~?7n3(2z)! 
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or, expressed in gamma notation, 


(9.2.12) (z+ yr (z ap 5) = 2° (22 + 1). 


If we write 2z+1=1—-—s then z = = and (9.2.12) becomes 


or, 


1—-s\  2I(1—s) 
(9.2.13) r( 5 \= ri) 


From (4.2.16), the reflection formula for the gamma function, 


a) aan) 


or, with m = 5, 


and this says 


(9.2.14) r(1 ) a 


So, putting (9.2.14) into (9.2.13), 


l-s 2wT(1—s) ., 1 s\ . (ms 
r( 5 i = = 2 IP(5) sin (F) Pc —s) 


(9.2.15) ey = qin (F)ra 5), 
2 


Inserting (9.2.15) into (9.2.11), we arrive at 
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¢(s) = n22°n7? sin (5) rd —s)(1—s) 


or, at last, 


(9.2.16) C6) =20n)~ “sin (=) rl — s)€(1-s), 


the functional equation I gave you earlier in (9.1.14). 
As a simple ‘test’ of (9.2.16), suppose s = 5. Then, 


<(5) = 2(2n) sin (F\r (2)s(3) 


which says, once we cancel the ¢(5) on each side,® that 
2 


1 = sin ()r(5). 


Is this correct? Yes, because the right-hand side is 


(i) (aon 


So, (9.2.16) is consistent for s = 3. 
As an example of how (9.2.16) works, let’s use it to calculate C(—1). Thus, with 


s=—l, 


Since T(2) = 1, sin (—%) = —1, and €(2) = &, then 


This result is the basis for an interesting story in the history of mathematics 
co-starring, once again, G. H. Hardy. 

In late January 1913 Hardy received the first of several mysterious letters from 
India. Written by the then unknown, self-taught mathematician Srinivasa 
Ramanujan (1887-1920), who was employed as a lowly clerk in Madras, the letters 


® We know we can do this because, as shown in the previous section, &(4) =-14...40. 
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were pleas for the world-famous Hardy to look at some of his results. Many of those 
results were perplexing, but none more than this one: 


1 
14+24+34+4+-:-=—-—. 
“pel pe eae DD 
Most professional mathematicians would have simply chucked that into the 
trash, and dismissed the clerk as a pathetic lunatic. It was Hardy’s genius that he 
didn’t do that, but instead soon made sense of Ramanujan’s sum. What the clerk 
meant (but expressed badly) is understood by writing the sum as 


1 1 1 1 1 21 1 1 


which is formally ¢(—1). Where Ramanujan’s 4 came from I don’t know but, 
indeed, as we’ve just shown using (9.2.16),¢(—1) = —+ Ramanujan had discovered 


a special case of the extended zeta function before he had ever heard of Riemann! 

After Ramanujan’s death, Hardy remarked (in his 1921 obituary notice that 
appeared in the Proceedings of The London Mathematical Society, as well as in 
the Proceedings of the Royal Society) that his friend’s mathematical knowledge had 
some remarkable gaps: “[He] had found for himself the functional equation of the 
Zeta-function,” but “he had never heard of ... Cauchy’s theorem,” “had indeed but 
the vaguest idea of what a function of a complex variable was,” and that “it was 
impossible to allow him to go through life supposing that all the zeros of the Zeta- 
function were real.” Hardy later said, with perhaps little exaggeration, that 
Ramanujan was his greatest discovery.” 

As a more substantial application of (9.2.16), [ll use it next to calculate the 
value of C(O), the penultimate calculation in this book. If we do something as crude 
as just shove s = 0 into (9.2.16) we quickly see that we get nowhere: 


C(0) = 2(2x)~' sin (0)'(1)¢(1) = ???? 


because the zero of sin(0) and the infinity of €(1) are at war with each other. Which 
one wins? To find out, we’ ll have to be a lot more subtle in our calculations. Strange 
as it may seem to you, we’ll get our answer by studying the case of s= 1 (not s=0), 
which I’ll simply ask you to take on faith as we start. 

Looking back at (9.2.9), we have 


-_ 1 ~ -} s—} 38-1 
O= Srrggsery ayh FATE vem 


° You can read more about Ramanujan’s amazing life in the biography by Robert Kanigel, The 
Man Who Knew Infinity: A Life of the Genius Ramanujan, Charles Scribner’s Sons 1991. 
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If we let s— 1 then we see that the right-hand side does indeed blow-up 
(as it should, because €(1) = oo), strictly because of the first term on the right, 
alone, since the integral term is obviously convergent. '° In fact, since 
lim,_,) 172 T(4s)s = ru) = vw = 1, then C(s) blows-up like +, as s— 1. Remem- 
ber this point—it will prove to be the key to our solution. 

Now, from (9.2.16) we have 


C(s) 


SU 9) = FO sin (@®r(a—s) 


From the reflection formula for the gamma function we have 


rer -3) =a 
and so 
M9) = Bsns 
which says 
cs) __F(s)sin (xs)(s) 


1 = = ; 
ae) 2(2n)*" sin (§) radia 2n(2n)* ' sin (#9) 


Since sin (ms) = 2 cos (8) sin (8), we arrive at 


T(s) cos(= =)6(s) 


(9.2.17) ci=s)= 


T(21t)S — 1 2 


an alternative form of the functional equation for the zeta function. This is the form 
we'll use to let s— 1, thus giving C(O) on the left. 


‘OT use the word obviously because, over the entire interval of integration, the integrand is finite 
and goes to zero very fast as x — oo. Indeed, the integrand vanishes even faster than exponentially 
as X— 00, which you can show by using (9.2.4) to write 
foe} -— ° 
w(x) = ae en ™ em etx 1 e? 1X fede em a e72™ + e3 1X teen a geometric 


series easily summed to give w(x) < =: x > 0, which behaves like e ™ for x ‘large.’ With 


s= | the integrand behaves (for x ‘large’) like atte x = for x ‘large.’ 
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So, from (9.2.17) we have 


— pray — tin LOS) 008 G(s) _ TQ) |, ms 
lim (1 — s) = 6(0) = lim ay! ~ lim cos (>)<(s) 
= Linco (3s 
or, 
(9.2.18) (0) = Lim £°8(2) 


Ts-1 s—1 


where I’ve used our earlier conclusion (that I told you to remember, remember?): 
C(s) behaves like 4+ as s— 1. The limit in (9.2.18) gives the indeterminate result 0. 
and so we use L’Hospital’s rule to compute 


_1, stoos(S)}_ 1, —§sin (§) 
Sa d{s— 1} a aa 


or, at last, we have our answer: 


To finish our calculation of particular values of C(s), let me now show you a 
beautiful way to calculate ¢(2)—which we’ve already done back in Chap. 7—that 
also gives us all the other values of €(2n) for n> 1 at the same time. What makes 
this calculation doubly interesting is that a// of the analysis is at the level of just 
freshman calculus. We start by finding the power series expansion for tan(x) around 
x &0, that is, the so-called Taylor series. 

Why we start with this is, of course, not at all obvious, but go along with me for a 
bit and you’ll see how it will all make sense in the end. So, what we’ll do is write 


CO 
tan (x) = So) Cex” = co + 1K + Ox” + 05x +--- 


and then find the c’s. This is a standard part of freshman calculus, and I’m going to 
assume that most readers have seen it before and can skip ahead. If it’s been a while 
for you, however, here’s a quick run-through. If you insert x = 0 into the series you 
immediately get tan(0) =0=cp. To find cy, first differentiate the series with respect 
to x and then set x =0. That is, 


d d f sin (x) 1 7 
—d ¢ = = = | 2 sas 
an aa dx { cos at cos ?(x) Te AO: 
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and so, setting x = 0, 


1 
cos *(0) " 
To find c, differentiate again and then set x =O (you should find that c.=0), 
and so on for all the other c’s. If you are careful with your arithmetic, you should get 
as 17 , 62 4 1,382 4, 


+ x x x ae 
15 315 2,835 155,925 


1 
tan (x) =x+ x + 


and where you stop calculating terms is a function only of your endurance! 
Next, we’ll use this result to get the power series for cot(x), by writing 


1 1 
cot (x) = = 
(x) tan (x) eal Da, 23s ; ean 62 O 1,382 a 
' 3 15 | 315 2, 835 155,925 
i 1 
— I Zz 17 
l 2 4 6... 
xX + =x 15* + 375% + 


Then, if you carefully perform the long-division indicated by the fraction inside 
the curly brackets, you should get 


_! ee 
cot (x) = 5 3 — GX ~ 945% ve 


or, 


1 
(9.2.18) cot (x) = x3 x Xx 


Okay, put (9.2.18) aside for now. 
Next, consider this amazing identity: for « any real, non-integer value, 
i 1 coo =(-1)" 
(9.2.19) cos (at) = Sin(cn) r+ 200 <a (nt) |}. 
This looks pretty spectacular, but in fact (9.2.19) is quickly derived via a simple, 


routine Fourier series expansion of the periodic function that is the repetition of a 
single period given by cos(at), —m <t< 1, extended infinitely far in both directions 
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along the t-axis.'' (You can now see why a cannot be an integer—if it was, then the 
n=4a term in the sum would blow-up.) 
If we set t=7 in (9.2.19) we get 


cos (am) = sin() E+ 2050 Locos (nn 


or, since cos(nm) = (—1)" and since (—1)"(—1)"= {(—1)7}"= 1, then 


1}1 oo 1 
sin (an) no 1 F 7 pam a? — =| 


1 5 (0415 foe) 2 1 ; oo 2(ar) 
cot (am) at ae ge es (an)? — n2n2” 


If we define x = ax then we get another series for cot(x): 
1 oo 2x 
(9.2.20) cot (x) = x + ae eae , 


From (9.2.20) it follows that 


1 foe) 2x2 oo 2x2 
— x cot (x) = Ss a ey a pao = ee 


2x? o ol 1 
my) n=1 p2 x 
nn 
2x? o | x2 x* x® 


= - + 2a+- 
q2 Ln=1 y2 me | age) ene 


or, 


2x? o 1 2x* o il 2x® o | 


(9.2.21) 1—xcot(x) = a ier ie se cern 


"| All the details in the derivation of (9.2.19) can be found on pp. 154-155 of Dr. Euler. 
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And from (9.2.18) it follows that 


1 1 
(9.2.22) 1 — xcot (x) = aa ++ 


Equating (9.2.21) and (9.2.22), and then equating the coefficients of equal 
powers of x, we have 


2 xo «ol 1 
aie : 
2 o «lL 

a ~ 45" 


2 co «Cl 2 
=a n® 945’ 


me WwW 


and so on. That is, 
i/r\  « 
02) =3(5) = 3. 
1 /x* xt 
= 2(5) <5, 
r 2 [n° i 
(6) sls) 945’ 
and so on. This isn’t the way Euler found €(2n) but, believe me, he would have 
loved this approach! 

One of the open questions about the zeta function concerns the values of 
(2n +1), n> 1. Not one of these values, not even just the very first one for C€(3), 
is known other than through the direct numerical evaluation of its defining infinite 
series. There are certainly no known formulas involving powers of pi, as there are 
for €(2n). Why there is this sharp distinction between even and odd arguments of 
the zeta function is one of the deep mysteries of mathematics, one that has puzzled 
the world’s greatest mathematicians from Euler to the present day. 

Now, some final comments. All that I’ve told you here about the zeta function 
and the RH is but a very tiny fraction of what is known. And yet, the RH remains 
today a vast, dark mystery, with its resolution hidden somewhere in a seemingly 
very long (perhaps endless), twisting tunnel with not even a glimmer of light visible 


ahead to hint that there is an end to it. Riemann is rightfully famous for many things 
in mathematical physics,” but it is no small irony that the most famous of all is his 


'2 When Riemann submitted his doctoral dissertation (Foundations for a General Theory of 
Functions of a Complex Variable) to Gauss, the great man pronounced it to be “penetrating,” 
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creation of a puzzle that has (so far) resisted all attempts by the world’s greatest 
mathematicians to solve. All that mighty effort has not been in vain, however. 

One of Isaac Newton’s contemporaries was Roger Cotes (1682-1716), who was 
a professor at Cambridge by age 26, and editor of the second edition of Newton’s 
masterpiece Principia, a work that revolutionized physics. His death from a violent 
fever one month before his 34th birthday—even younger than were Riemann and 
Clifford at their deaths—cut short what was a truly promising scientific life. It was 
reported that, after Cotes’ death, Newton himself said of him “If he had lived we 
might have known something.” No one ever said that of Riemann, however, 
because the world had learned a /ot from him even before he departed this life. 

This book starts with a story involving G. H. Hardy, and for symmetry alone let 
me conclude with yet one more. Hardy was fascinated by the RH all his working 
life, and never missed a chance to puzzle over it. One famous story, that amusingly 
reflects just how deep was the hook the RH had in him, relates how, after conclud- 
ing a visit with a mathematician friend in Copenhagen, Denmark, Hardy was about 
to return to England. His journey was to be by boat, over a wild and stormy North 
Sea. Hoping to avoid potential catastrophe, Hardy quickly, just before boarding, 
wrote and mailed a postcard to his friend declaring “I have a proof of the Riemann 
hypothesis!” He was confident, Hardy said later, after reaching England safely, that 
God would not let him die with the false glory of being remembered for doing what 
he really had not achieved. Hardy, it should be noted, was a devout atheist in all 
other aspects of his life. 

By some incredible coincidence, I write these final words of this book on the 
British cruise ship Queen Elizabeth, while returning from holiday in Norway. The 
QE is home-based in Southampton, England, and my journey there has taken me 
through the North Sea and right past Copenhagen. So, here I sit, a 100 years after 
Hardy with my feet propped-up on the railing of my stateroom balcony, writing of 
his little joke perhaps right where he had sailed a century before. Somehow, I think 
Hardy’s ghost is not at all surprised as it peers over my shoulder that the mystery of 
the RH is still unresolved and, as far as anyone can see into the future, it may well 
still be a mystery a 100 years from now. 


“creative,” “beautiful,” and to be a work that “far exceeds” the standards for such works. To 
actually be able to teach, however, Riemann had to give a trial lecture to an audience of senior 
professors (including Gauss), and Gauss asked that it be on the foundations of geometry. That 
Riemann did in June 1854 and—in the words of Caltech mathematician Eric Temple Bell in his 
famous book Men of Mathematics—it “revolutionized differential geometry and prepared the way 
for the geometrized physics of [today].” What Bell was referring to is Einstein’s later description 
of gravity as a manifestation of curved spacetime, an idea Riemann might have come to himself 
had he lived. After Riemann’s death the British mathematician William Kingdon Clifford (1845— 
1879) translated Riemann’s lecture into English and was perhaps the only man then alive who truly 
appreciated what Riemann had done. Clifford, himself, came within a whisker of the spirit of 
Einstein’s theory of gravity in a brief, enigmatic note written in 1876 (“On the Space Theory of 
Matter’’), three years before Einstein’s birth. Sadly, Clifford too died young of the same disease 
that had killed Riemann. 
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For mathematicians, however, this is as great a lure as an ancient, magical 
artifact hidden in a vast warehouse would be to Indiana Jones, and so the hunt 
goes gloriously on! 


9.3. Challenge Questions 


Since this chapter deals with the unresolved issue of the RH, I’ve decided to be 
more philosophical than analytical with the challenge problems. So, rather than 
problems, here are three questions for you to ponder. 


(C9.1): As in the text, let p, denote the nth prime: p; = 2, pz = 3, and so on. Suppose 
we define q, to be the first prime greater than p,p2...p,+1, and then calculate 
dn — (P1P2. - -_Pn)- If we do this for the first seven values of n we get the following table: 


n P1P2- + -Pn PiP2---Pnt 1 dn Qn — (P1P2- - Pn) 
1 2 3 5 3 
2 6 7 11 5 
3 30 31 37 7 
4 210 211 223 13 
5 2,310 2,311 2,333 23 
6 30,030 30,031 30,047 17 
7 510,510 510,511 510,529 19 


Looking at the right-most column of the table, does a conjecture strongly suggest 
itself to you? Can you prove your conjecture? It’s questions like this about the 
primes, so easy to cook-up and oh-so-hard to prove, that fascinated Riemann in 
1859 and continue to fascinate today. For example, the twin prime conjecture that I 
mentioned in Sect. 9.1 has been the basis for recent (2013) excitement in the world 
of mathematics, with the proof that there is an infinity of prime pairs separated by 
gaps of no more than 600. A long way from the original conjecture with a gap of 
2, yes, but still... 


(C9.2): While numerical computations generally don’t prove theorems (although 
they might well disprove a conjecture by finding a counterexample), they can be 
quite useful in suggesting a possibility worthy of further examination. For 
example, since Fig. 9.1.1 indicates that, for e>0, lim,9C(1 —€) = —oo and 
lime.oG(1+¢)=+00, then it is at least conceivable that 
lim,_,9 {C(1 — €) + ¢(1 + €)} could be finite. In fact, it is easy to use MATLAB 
to compute the following table: 


€ {C1 —e)+C1+e)}/2 
0.1 0.577167222774279 
0.01 0.577215180384336 
0.001 0.577215660056368 
0.0001 0.577215664853611 
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From these calculations it appears that lime.o {C(1 — €) +61 +e)}/2 = 
0.57721566.... Does this suggest to you that the limit is a well-known constant? 
Can you prove your conjecture? 


(C9.3): Two undergraduate math majors, Sally and Sam, are discussing the RH in 
general and, in particular, the view held by some mathematicians that the reason 
nobody has solved the question, even after 150 years of intense trying, is simply 
because it’s unsolvable. Sally says while that may well be true, it’s also true that 
nobody will ever be able to prove the RH is unsolvable. When Sam asks why not, 
Sally replies “If the RH could be shown to be unsolvable, that would mean nobody 
could ever find a complex zero off the critical line, even by accident, no matter how 


“10 
long they looked. Not even if they could check zeros at the rate of 10!" each 
nanosecond, no matter how high up that exponential stack of tens you went. That’s 
because if you did find such a zero then you would have proven the RH to be false. 
That’s a contradiction with the initial premise that there exists a proof that the 
problem is unsolvable. But that would mean there is no zero off the critical line, and 
that would mean the RH had been solved by showing it is true. That’s a contradic- 
tion, too. The only way out of this quagmire is to conclude that no such proof 
exists.” 

Sam thinks that over and, finally, replies with “Well, I’m not so sure about all 
that. There are infinitely many complex zeros, and so no matter how many of them 
you could check each nanosecond, it would still take infinite time to check them all. 
So, you’d never be done, and a contradiction doesn’t occur until you are done.” 

What do you think of each of these arguments? 

As you ponder the words of Sam and Sally, we come to THE END and your 
author rides off into the mathematical sunset like the ‘Arizona ranger with the big 
gun on his hip’ in that old but still great western ballad by the late Marty Robbins. 
This book has given you a lot of ammo for your big integral gun, however, so as I 
say good-bye I’ll simply wish you success (when you next match wits with a new 
‘outlaw integral’) as follows (because I grew-up in 1950s Southern California, just 
100 miles north of the Mexican border): 
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Adios, mi amigo, vaya con Dios. 


Reproduced by permission of Toon Vectors (Austin, Texas) 


Solutions to the Challenge Problems 


Preface 


Since x + 1 = 1, then multiplying through by x gives x°+1=x or, rearranging, 
x*=x-— 1. Multiplying through by x again, x* = x? — x or, substituting our expres- 
sion for x*, x’ =x — 1—x =— 1. Squaring this gives x°=1, and then multiplying 
through by x we have x’ =x. So, substituting x’ for x in the original x + 4 = 1 we 


have x’ + 4, = 1 and we are done. 


Chapter 1 


(C1.1): Change variable to u=x—2 (and so du= dx) which says 


8 7 
dx © du. ®du [du : ~e 6 
[ta fang [2+ [|< meors+oeot 


= lim (In(—e) ~ In(—2) + In(6) — In(e)] = lim In s aad 2 
€ = € 


— 


; 6 
= lim {Ing |=] | - = In(3) 
e0 
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That is, 
8 dx 
fy 7 =). 
3 1-e 3 
d d d 
| ay = limeo | ss + lime—o | — In both integrals 
0 (x—1) e a1) ra, ome bi 


3 
° dx 
on the right, change variable to u=x — | and so du=dx. Then | ae 1p = 


P “© du 2 du z 1/3 \ |-€ 1/3 2 : 1/3 
tim) | Sst | Sep = im {(30t9) 55 + (3009) 2} = tim {(-2)"°- 


(—1)" + (2) — (e)'?} = 3f1 4214}. 


(C12): Write | ae -| as | & 


< —— = 
1 vVx—1Vx2+x+1 1 Vx — Vx? 
oo dx 
————., where the inequality follows because in the integral just before the 
| oy ae | quality gral J 
one at the far-right I’ve replaced a denominator factor in the integrand with a 
quantity that is smaller. Now, change variable to u=x — | in the last integral. So, 


1 Vx¥—1 


[- ous < [- os = | o or, writing the last integral as the 
1 VS8=—1 Jo Ut] fa Jp WP+UI? 

. co dx I du 2 du 
sum of two integrals, we have | aaa < | Beau i wi? wl 


We make the inequality even stronger by replacing the denominators of the 
oo dx 


1 Vx3-1 


integrands on the right-hand-side with smaller quantities, and so | < 


' du °° du : ro 
| ant | <= (204?) [4 — (20 aT =242=4. 


1 
d 
(C1.3): In Feynman’s integral | ee change variable to u=ax+b 
o [ax + b(1 — x)] 


d *1/d 
(l1—x) and so dx= aa, and the integral becomes | =( . ) = 
a—b pur\a—b 


1 1) ja 1 fl 1 a—b 1, E isancd 
a {-zhie = ne “| Geib ab just as Feynman claimed. 
This all makes sense as long as the integrand doesn’t blow-up somewhere 
inside the integration interval (that is, as long as there is no x such that ax+b 
(1 — x) = 0 in the interval 0 < x < 1. Now, the quantity ax + b(1 — x) does equal zero 
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when x = 


b 
and so we therefore require either b < 0 (call this Condition 1) 


—a —a 


b 
or that D > 1 (call this Condition 2). For Condition | we can write, with k some 


—a 


b 
positive number, b = —k. Or, b=— bk+ak and so, multiplying through by 
2 


a, ab= — abk + a°k. Solving for ab, we have ab = 7 K 
obviously, so is a’) we then conclude that ab > 0. For Condition 2 we can write, 


Since k is positive (and, 


b 
with k some number greater than 1, a k. Or, b= bk — ak and so, multiplying 
—a 


2 
k 
through by a, we have ab=abk—a’k. Solving for ab, we have ab = = : 


Since k > 1 we conclude that ab > 0. That is, for both conditions (conditions that 
insure the integrand doesn’t blow-up somewhere inside the integration interval) we 
conclude that ab > 0. That is, a and b must have the same algebraic sign and that 
eliminates the puzzle of Feynman’s integral. 

OO _—CX CO AT 


y 
= dy with the change of variable y = cx 
y 


(C1.4): Transforming | dx into | 
0 0 


(assuming c>0) is straightforward. With x=* we have dx =1dy and so 


OO cx 00 a—ct 0 ,-y 
| dx = | ae dy) = | a dy. This is formally okay, but it is really 
o Xx 0 ¢ o Y 


just an exercise in symbol-pushing. That’s because the key to understanding the 
0 ey 

. * * e€ . > 

puzzle is to realize that the integral | —dy doesn’t exist! Here’s how to 

0 Y 


see that. For any given finite value of the upper limit greater than zero (call it 6), 
5 ay 
the value of | © ay = oo. That’s because for 0<y<6 we have e * a ie 
o y 
8 e-y 5 Q-8 
3 ; 
and so | —dy> | —dy= es {In(y}|, = oo. Thus, when we write 
on o Y 


OO | ax —e bx OO @—ax love) e7 bx Oey Oey 
—— dx = dx dx = dy dy what we 
0 x o xX o xX 0 Y 0 Y 


are actually doing is subtracting an infinite quantity from another infinite quantity 
and the result is undefined. A deeper analysis is required to determine the result and 
that, as stated in the challenge statement, is done in Chap. 3. The problem of 
subtracting one infinity from another was given an interesting treatment in the short 
science fiction story “The Brink of Infinity” by Stanley Wienbaum (1902-1935), 
which appeared posthumously in the December 1936 issue of Thrilling Wonder 
Stories magazine (it’s reprinted in the Wienbaum collection A Martian Odyssey 
and Other Science Fiction Tales, Hyperion Press 1974). A man is terribly injured 
when an experiment goes wrong, and he blames the mathematician who did the 
preliminary analysis incorrectly. In revenge on mathematicians in general, he lures 
one to his home. Holding him at gun point, he tells him he’ll be shot unless he 
answers the following question correctly: the gunman is thinking of a mathematical 
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expression and the mathematician must figure out what that expression is by asking 
no more than ten questions, One of the mathematician’s questions is “What is the 
expression equal to?” and the answer is “anything.” And that is just what the end of 
the story reveals to the reader—the gunman is thinking of “oo— oo.” 


Chapter 2 
(C2.1): I i In) ax ch iable to y=%. Then x=4y and so dx=4 d 
1): In | ———— dx change variable to y = ¥. Then x=4y and so dx= : 
0 Vax— 2 . od : : 
' ~~ In(4y) ' In(4) + In(y) 
The integral then becomes | ay=| ——_————— dy= 
0 1/ l6y — 16y? 0 V/y-y? 


1 1 

dy In(y) : 

in(a)| | | dy. In both of these last two integrals make the 
oV¥VI-y JoVyvI—-y 

change of variable to y=sin*(0), which means that when y=0 we have 0=0, 

1 


dy 
and when y=1 we have 0 = £. Also, &=2sin(®)cos(®) and so | = 
: = o VyVI-y 
[ 2sin (0) cos (0) w=2f sin() s25(0) 49-2] ao=x - 
0 y/sin2(0)\/1 — sin2(6) 0 sin (8) cos (0) ; 


*_Infy) _ = me latent sin (8) cos = aa sin = 
ls], Sn (Ojoos( 28M 0)e0s(0)40 = 4] In{sin(0)}40=4 


[—Fin(2)] =-—2nIn(2) where I’ve used the Euler log-sine integral we derived 


in (2.4.1). So, what we have is 


+ In(x) | dy ‘a 
———— dx = In(4)} ——+— n(y) = - 
ee on], Fiza + |. ae 
= In(2”)x — 2nln(2) = 2In(2)x — 2aIn(2) = 0 
and we are done. 


dx. In the first 


1 i , 
d 1 d 1 _2 
(C2.2): We start with | 5 a | s | es 
oX +1 3Jox+1 3Jo xe —x+1 
L_ a 
integral on the right let u=x+1 (dx=du). Then, -— | Ds 
3 Jo Xt+1 


1(?d 1 1 
| ane zfin(u)}]; = gin(2). In the second integral write (following the hint) 
1 Uu 


if x-2_ if x-2_ if a ! 

x= x= x. Next, let u=x—= 

3Jox?—xt+1 3 Jox2-x+143 3 0 (x—)?+ (of) 2 
2 2 
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if’ x2 Ae u-3 


and so dx=du) and we get dx = 
‘ ) : a rarer 3J-1/2 /3 
- () 


0 jas u Eye? - te 
| 7 du | 3: The first integral on the right is zero as 
ler ee (4) 2J-1/2yr24 (4) 


the integrand is odd and the limits are symmetrical around zero, and so 


ij 2=2 1p du 1S 2 an—1f2u) 145 1 -1f1 
5| eo Alls a” {Fan (2) fEy=—sa{ tn (5) 


or, 


1 dx 1 TT 
es 5 (Ce 


This equals 0.8356488... and MATLAB agrees, as quad(@(x)1./(x.‘3 +1), 
0,1) = 0.8356488. ... 


- d 
(C2.3): Define the integral I(m — 1) = | way which we’ll then integrate 
0 xX 
by parts. That is, in the standard notation of {u dv=uv— fv du let dv=dx and 
1 d i d 
= at? Then, v=x and es 4m = 7] and so | — 
(x4 + 1) dx (x¢+1)™ o (x* +1) 
x 44 ia - ea FE x ee 
7m + 4m 7 x = 4m ————mrr:~«dx. Now, write 
Beaty 8 o (xt+1)™" oe nh ake 
2 4 io) 4 0 
| 4 - m+1 dx | oka | : 
o (x4*4+1) o (x44 ml o (x44 1)" 
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So, 
~ dx [ 1 i 1 
m = 4m m dx dx| or, rearranging, 
|, (x4 + 1) 0 (x4 + 1) 0 (x4 4 1 atte | ging 
4m| —— = 4m| 7 x - | r x a 
o (x#+1)™ 9 (x*+1) 9 (x44 1) 
oo dx 
= (4m - 1 = 
( | (x* +1) 
Thus, 
7° dx 4m -1 7 dx F ; 
0 ap 4m), WFP and we are done. 


(C2.4): The denominator of the integrand is zero at the values given by 
b+ vb? —4 


x . If —2<b<2 then both of these values are complex and so not 


on the real axis, which means that the denominator never vanishes in the interval of 
integration. And if b < — 2 then both values of x <0, which again means that the 
denominator never vanishes in the interval of integration. So, the integral in (2.4.5) 
exists only if b<2. MATLAB agrees, as experimenting with guad shows that 
random choices for b that are less than 2 always give values for the integral that 
are either zero or pretty darn close to zero, while any b >2 results in MATLAB 
responding with ‘NaN’ (not a number), MATLAB’s way of saying the integral 
doesn’t exist. 


°° In(1 d d 
(C2.5): In | i) dx let u=In(1 +x) and dv = teak Then, du = = and 
0 XVx x3/2 1+x 
* In(1 + x) In(1 +X) yoo ~ 1 dx 
= 4% d | dx = —2 | = 
Vee wer Se Ne ee ja © Ny alee 


e d 
2| a Next, change variable to t = Jx and so x =t? and dx —2t dt. 


o (L+x)Vx 


© In(1 +x) ee Dradt ~ dt se 
Th ——— dx=2 —4 dnl? Sa) aa 
ws | xjx I (1+e)t | (om (|g =4() = 2" 
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Chapter 3 


© In(1 2y2 
(C3.1): Start with I(a) = | tai dx and differentiate with respect to a 


0 b? +x? 
d a Qax? ee A B 
to get = dx = + dx and so 
oS" da I (1 + a2x2) (b? + x2) I ti + atx? pb? + 3} 
Ab? + Ax? +B + Bax” = x°(A+ Ba’) +Ab’+B=2ax’. Thus, A+Ba*=2a and 


Ab*+B=0. Solving for A and B, we have A = => and B = — at, So, 
di 2a [ dx 2ab* [ dx 
da 1—a2b?Jo 1+a2x? 1—a2b2 Jo b* + x? 
fa [ dx 2ab* [ dx 
~ 1-atb? Jo S+x? 1a? Jo b? +x? 


2 2 

7 2ab 1 x 

a =| ee) -1 fore) 
=F ae (a) tan ‘(xa) le “aa (5) tan (7) 


T 2 2ab n, 1 — ab 1 
= = = : 
2|1—a2b* 1—a2b?} 2° |1—-a2b? 1+ ab 


and thus = |x ! 
1+ ab 


— = 1——_ ‘is Ti teed a and 
da 1+ ab da 


1 tdu x . 

therefore da = b du. Thus, I = 2} 2— = pny) +C where C is a constant of 
u 

integration. We know from the very definition of I(a) that 1(0)=0, which says 

C=0. So, at last, 


x In(1+ab 
(fee) = 7) , 


; : °° cos (ax) ia 1 
(C3.2): Write \_ we _ 2 dx = Ie COs (ax) fa=ae=s} dx = 
1 (* 1 [ [°° cos (ax) °° cos (ax) 
w]e {warts} * =al[ pay tear | 


In the first integral let u=b+x (and so du=dx), and in the second integral let 


io) 1 ‘Co —ab 
eee | - (ax) 2 | cos(au—a it 
—oo bY — x? 2b [Jo 
i cos (ab — au) ai) 1 fr cos (au — ab) aad ii cos (ab — au) dal ena 
66 U 2b —oo u —oo u 
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du. Now, since 


cos(—0)=cos(®), we have | oe) Ae: | cos (au — ab) 
—oo b — x? b is 


cos(x — y)=cos(x)cos(y)+sin(x)sin(y), then i: cos (en) dx = :| ea ay + 
1 [- sin (au) sin (ab) du = £23 (ab) [- cos (au) sin (ab) 
b u —  b b 


du+ (du. The 


—oo —oo 


os (au) 


u 
For a> 0 the second integral is x from Dirichlet’s integral. So, 


first integral has a Cauchy Principal Value of zero as 2 is an odd function. 


co cos(ax) ____ sin(ab) 
ee pete ean 


(C3.3): Since | sats 
ob 


T : : . 
x= ae then as the integrand is an even function we 


+ x? 
. cos (ax) nm °° cos (ax) °° cos (ax) 
can write dx =—e*. Thus, | dx + | dx = 
{_ b? + x2 b _~ b? 4x2 _o~o b?— x? 
T 4, _Sin(ab) i 1 1 9{~ cos (ax) 
“ea = —>—~ + —— p dx = 2b d 
ea b Lg ey Pag pow Xx how X 


and so we immediately have our result: 


_pbt— xt 2b3 


” cos(ax) _ _ m{e~* + sin(ab)} 


(C3.4): Notice that since the integrand is an even function we can write 


ii xen) dx = | Xx sin (ax) fees} dx 


1 i Xx sin (ax) a+ | x sin (ax) rn 
4b] J_, b+x «6 b-x 

In the first integral change variable to u=b+x and in the second integral to 
u=b-—x. Then, 
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[39 1 F eaeisinr aus | ene et) » 


x 
es u os u 


0 x2—b? 4b 


a u hee u 


1 i (u— b) sin (au — ab) | [- nla 


cae | sin (au — ab)du b| anna) | F 


lo.@) 


In the first integral change variable to s = au — ab. Then, | sin (au — ab)du 


—oo 


1 10.6) 
==| sin(s)ds which has a Cauchy Principal Value of zero. Thus, 
a 


—oo 


~ xsin(ax) _ 1 /* sin (au — ab) - 
| x2 — be — 5) \_ 3 du or, as_ sin(a — B) = sin(a)cos(B) — 
gosteyaintp): | a cae |. sin (au) cos (ab) - cos (au) sin (a ) in _ 
5| os (ab) Sin (8) ay — sin (ab) cate) 4a 


The first integral is, from Dirichlet’s integral, 1, and the second integral is zero 
because the integrand is an odd function. Thus, 


fee eS = cos(ab) ; 


© s2oe 


(C3.5): Start by recalling the trigonometric identity cos (ax) sin (bx) = 

5[ sin {(b — a)x} + sin {(b + a)x}}]. Since the cosine is an even function we have 

cos(ax) = cos(lalx) and so cos(ax) sin (bx) =5[sin {(b—|a|)x} + sin {(b+ |a|)x}] 
= in(b 1 (* sin{(b— 1(* sin{(b 

and so | cos (ax) ante) dx = | smn (8 =a) dx + | use a ES dx. 
0 x 2Jo X 25o x 


From (3.2.1) we have 


c>0 

| sin (cx) 4 0, c=0 
0 x ai 

-> c<0 
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and so, 
(1) if lal <b then b — lal > 0 and b+lal > 0 and so 


°S in (b 1 1 
| cos (ax) sm(by) dx = (5) + () = a 
0 x 2\2 2\2 2 
(2) if lal > b then b — lal < 0 and b+lal > 0 and so 
Y in (b 1 1 
[Fetes 0 oc (-8) +4) <0 


(3) if lal=b then b — lal =O and b+lal > 0 and so 


| cos (ax) a dx = 5(0) + °(5) = 


d 
(C3.6): We start by following the hint and let x = cos(2u). Then = —2sin (2u) 
Xx 
and so (remembering the double-angle identity) dx= —2sin(2uj)du= — 4 sin(u) 


1+x, [ 1+ cos (2u) 
n/ 


1 
cos(u)du. Thus, Ibe ie << (uy 4 sin(u) cos(u)du} = 


r 


2 1+ cos (2u) 
af sin (u) cos (u) 


——————~ du. Next, remembering the identities 1-+cos 
1 — cos (2u) 


1 1 5 
(2u) = 2 cos*(u) and 1 — cos(2u) = 2 sin’(u), we have | es dx = 4| sin (u) 
=e 0 
2 i ee (er | 1 
cos (u) ec) du = 4] cos *(u)du = 4| = +-=cos(2u) pdu = 44 -u+ — 
2sin2(u) 0 i Loe 8 2 4 


—xX 


1" oo 
(C3.7): In | | uae ; dx > dy let t=x+-y in the inner integral. Then dx = dt 
0 (x+y) 


1 = ly 4-2 LtY dt Lt+y dt 1 
and | $a [a= | S—251 a= (Zh? 
0 (x+y) . t ae: ye tjly 
ieee | 
2y(-—— = + 
»( 52) y ity) “lady? ¥ 


1 1 1 _ 1 d 
this reduces to — 3: So, | | = ue dx > dy= -| — Let t=1 +y, 
(I+y) 0 (Jo (x+y) o(1+y) 


or, after a little simple algebra, 
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2 dt 1\7 6 1 1 
and this integral becomes i os ( ) i= ( s+1)=-4 That is, 


1 1 x-y 1 ; ; 
dx > dy=—-. If you repeat this business for 
o(xty) 2 


1 (pl 
- 1 
| if aie | dx you'll get +5 The lack of equality is caused by the integrand 


blowing-up as we approach the lower left corner (x = y =0) of the region of integration. 
Don’t forget the lesson of Chap. |—beware of exploding integrands! 


(C3.8): We know from (3.7.1) that (with b = 0) | e-® dx — Ve Now, following 


oe) 7 ioe) 4 foe) ote 
the hint, consider | ee +x qx = | e- (bx) gy — | e-#(”-®) dx = 
—oco —co 


—0o 


oe) “ ore) foe) 4 
| e -a(x Sar -) &x=| aoe a(x— 8) ax=e| eX) dx, Next, change 


—oo —oo —oo 


b on 2 2 [% 2 2 
variable to y =x oe Then, ct eo (sk) dx = ce e  dy= ey and so 
a 


—oo —coo 


i(a,b) = | eH dy — ef /. Differentiating with respect to b gives us 


ol [* ax? 
a = I. so dkee aie Pa mek /% Setting a=1 and b=—1 says 


TOOK dy = —1/net = 5a \/e = —1.137937.... MATLAB agrees, as quad 
1 nema opt 0,10)=— 1.137938.... If we differentiate I(a,b) with respect 


al. [* 2 4° 2] op |e e 
to a, we get =| Hx2eae tox gy — [EF] ex| per aa = 
a a| 16a? 


a a 


0a 
b2 2 2 
Vi Ta ek aa ek, So, with a=1 and b=-l1 we have 


: 1 3 
| re *dx= VEG et oe et= zV tVe = 1.7069068.... MATLAB agrees, 
as quad(@(x)x.\2.*exp(-x.42-x),-10,10)= 1.706907. ... 


(C3.9): Following the hint, differentiation gives 


—2a a= {etme al — —. So, | sin =. aa 
(x? + a?) 2 a 0 x(x? +a’) 2 


a’(me~*™) — (1 —e~*™)2a 
—2a5 
°° sin (mx) 1 2+ma on 
53 dx =-G]1 e ; 
0 x(x? + a’) 2a 2. 


\ which, after a bit of simple algebra becomes 
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Chapter 4 


d 1 
(C4.1): Change variable to u = /x = x? and so “" = —~_ which means that 


dx = 2,/x 


1 
dx =2,\/x=2udu. Thus, I(n) =| (1 — vx)" ax = | (1 —u)"2u du = 
0 
: T(2)r(n+1) | In! 
2| u(1 — u)"du = 2B(2,n+ 1) = 2 or, finally, 
os PTE = rae)? oe) 


I(n) = f,Q- vx)" dx = 


a (n+2) ° 


: 2 1 
In particular, 1(9) = Toa) _— 


u 


(C4.2): Make the change of variable u = — In(x). Since In(x)=—u then x=e~ 
and so dx=—e “du. So, f§x™In"(x) dx=f2e ""(—-u)"(-e “du) =(—1)" 
fzeute ™*P" du. Change variable again, now to t=(m+l1)u and so 


dt ; ST dt 
du = . Thus, | x™In"(x) dx = (-1)"| ( :) e' 


m-+ 1 0 0 m+ as 


—| n 10.0) 
aaa |, t"e' dt. From (4.1.1) we have T'(q)= f Xt?” 'e~' dt and so our 


integral is the q—l=n_ case, that is, q=n+l  and_= so 


; (—1)° 
x™In"(x) dx = —~—~—_T(n + 1). But by (4.1.3), [+ 1)=n! and so 
| (x) (ay ( ) y ¢ (n+1) 


ik x™n(x) dx => 


(m+anti" 


(C4.3): Write the double integral over the triangular region R as {| x*y? dx dy 
R 


1 I-x I yrtl\ 
=| x? | y? dy ax =| a4 (2 —)| ade 
0 0 0 b+1/'° 
\ 


= a, x*(1— xl dx. From the defining integral for the beta function, B(m, 


~ BHI 
n=| px —x)"~ ‘dx, we have m—1=a and n—1=b+1. Thus, m=1+a 
and n=b+2. So, 
{| a> dx dy pL ta b+2) _ PU tall (b +2) al(b + 1)! 

x x — = i _ 

a . b+1 (b+ DI (at+b+3) (b+1)(a+b+2)! 

alb! 


(a+b+2)!" 
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(C4.4); Simply set b=1 and p=} in (4.3.2) to get | SHE i 
0 vx 
1 1 1 . °° cos (x) 
— = a . Do the same in (4.3.9) to get | dx = 
21 (4) sin (8) 2/t5 re 0 «(VK 


by a fi 
2r(5)cos(7)  2vmj, V2 
ae hee = ib : . : 
(C45): e *Y sin (bx) dx > dy = > dy and so, with the integration 
0 c be + y? 
00 00 - love) dy 
order reversed on the left, sin (bx) e *dypdx=b] == 
0 cl c b + y? 


1 oe) ae mau: 
bfpiam "(YEP on ff sin bof SHI d= sano) — tn (8) = 


b 
i tan~'(¢). But, since tan ~!(£) aN tnt 2 ae you don’t see this, 
2 b 2 c 


draw the obvious right triangle—we have 


c 


b 


ee em ae 
f sin(bx) — dx =tan71 (), 


a generalization of Dirichlet’s integral, (3.2.1), to which it reduces as c— 0. If 
b=c=1 we have | SHAK) 6 ge tan 1) = % = 0.78536.... MATLAB 
0 xX 


agrees, as quad(@(x)(sin(x)./x).*exp(-x),0,20) = 0.78539. ... 


(C4.6): Following the hint, make the substitution x° = y in | Tae dx. Then, 
0 xX 


d b d oe) a 
= bx? be b 7 by! or, dx= z ;, SO, | a dx = 
dx X y by! ® 9 (1+x?) 
00 a/b d 1 apt 1 ita] 
| : < sd r= | = ody = | a = dy. This is in the form of 
o (l+y)by!* bJo +y) bJo (1+y) 
m—1 
i dy where m= s and m+n=c 


the beta function B(m,n) = | = 
o (1+y) 


1 ae - 1 1 
eee er ee . Thus, | _—__. dx =18 oe ed Pe 
b o (+x°) b b 


lta _ lia 
rete =) For example, if a=3, b=2, and c=4, then | 


lore) x3 


——— dx 
Br (c) 0 G42 
regyr@—43) rere) mt 4 
= Or (4) Or (4) = 23) =a5 = 0.0833333... MATLAB 


agrees, as quad(@(x)(x.43). /(U +x.42).M4),0,100) = 0.083334. . .. 
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k d 
(C4.7): Writing (4.4.2) for an inverse first power force law, —— = mv, which 
y y 
d 
separates into —k& = mv dv and this integrates indefinitely to —kln(y) + In(C) 
y 


=-=mv? where C is an arbitrary (positive) constant. Since v=0 at y=a 


we have — kIn(a)+In(C) =0 and so In(C)=kIn(a). Thus, —kIn(y) + kIn(a) = 


i 4.1 fay a _ (dy\? 2k (a 
=mv- = =~ m{ — ] =klIn{ —}]. That is, |— } =—In|{ — }. Solving for dt, dt = 
2 2, dt y dt m y 

T 


/ d [m(° d 
+ mand so | dt=T=+ |. y . Letu = “and so dy =a du. 
n(s) in(3) 


° adu m (° du : : ; 
Then, T= + =a or, using the minus sign to 
1 4/In(+) 2k J, \/—In(u) 


1 
/ d 
give T>0, T=a =| aay From (3.1.8) the integral is ,/x and so 


0 «/—In(u) 
T=a pea 
2k 


(C4.8): The reflection formula for the gamma function says I(1—m) = 


—_——_—_—.. For m> 1 we have 1 —m<0, and so on the left of the reflection 
T(m) sin (mz) 
formula we have the gamma function with a negative argument. On the right, 
both [(m) and z are positive quantities, while sin(mz) goes through zero for every 
integer value of m. So, as m increases from 2, | — m decreases from — |. As each new 
negative integer is encountered the gamma function blows-up, in both directions, as 
the sign of sin(mz) goes positive and negative as it passes periodically through zero as 
m increases. 


Chapter 5 


(C5.1): The integrand is —*> = (1 — x™)(1+x"+x7" + x*" +--+) and so I(m,n) = 
xkotl 


1 1 
| (1 = x™) ee aa dc = an | if _ oot dx = ae id = 


0 


1 
SS 1 1 Soe 
| k=0)kn+1 kn+m+I1( 4*-0(kn4+1)(knt+m+4+1)— 
mr 

k=0 (kn + 1)(kn + m-+ 1)’ 


xkn+m+1 


kn+m+1 
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For given values of m and n this last summation is easy to code as an 
accumulating sum inside a loop, which is a near-trivial coding situation for 
any modern language. The MATLAB code named cp5.m does the case of 
m=9,n=11: 


cp5.m 


m=9;n=11;s=0;k=0; 

while 1>0 
fl=k*n+ 1,f2=fl+m;k=k+1; 
s=st1/(f1*f2);m*s 

end 


Since | is always greater than 0, cp5.m is stuck in an endless while loop, and I 
just let the code run while I watched the successive values of the summation stream 
upward on my computer screen until I didn’t see the sixth decimal digit change 
anymore (and then I let the code run for 15 or 20 s more). I finally stopped the code 
with a Control-C. This is less than elegant, sure, but totally in keeping with the 
pretty casual philosophical approach I’ve taken all through this book. The results: 
19, 11) = 0.972662 and I(11, 9) = 1.030656. 


k k +1 
; in dx i a dx k-1 [1 dx 
(C5.2): Start by writing | = (—3) = 1—,. Since | a y i-1 | 


k j+1 
. n dx n k-1 [PT dx n 1 
we can write Se [= Daw | aoe (1-_) = 
j 
n 1 
a) dp Next, you'll recall from the opening of Sect. 5.4 that 
n 1 
n) = een ~ n) where Euler’s constant y= lim,...y(n), and so 


a : = y(n) +In(n) which says a i pe fs ae y(n) — In(n). 


Writing out the double summation, term-by-term, we have 


k= 1: nothing 
a [ dx 
cial em 
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Adding these terms vertically to recover the double-sum we have 


(n pf S +e af S40 af Se sel" dx 


1 x? x2 x? n-1 X? 
2(n—1)dx. [? m—2)dx. ft (m-—3)dx [* dx 
~ | x? +] x? v I x +| 1 oo sa ee 


: on ft eed) 

The general form of the integrals is 7 
x 
j 

integration is j <x <j+1 we have, by definition, |x| =j. So, n— y(n) — In(n) = 


dx. Since the interval of 


i — dx. Or, as {x}=x—|x] and so |x| =x-— {x}, then n— |x| =n— 
1 


[x — {x}]=n—x+ {x}. Thus, 


n— y(n) — In(n) -[-— a&x=a] S - [44] Sas 


=m) 
=n -* P= fac + [Sax =n 1-* = n(n) + | an 


=n-—1-—In(n)4 [ Ba 


1 x? 


or, | wt dx = | — y(n). Finally, letting n— oo, we have 


[3 ie tT eee 


(C5.3): For the €(3) calculation, things go in much the same way. as with 
dx wok filth dx | ete r 
a= i], Pee a); =4( b), We ee iy, —_ 


n 1 1 ; ie 
re3( =) =e 3 bnl3), where limp. 6,(3) = €(3). Writing out the 


double summation, term-by-term just as we did in (C5.2), and then doing the 


‘adding vertically’ trick, you should now be able to show that sn—30,(3 j= 


[sgtax—af S'S [Sax n()|h— (ab) 
[ St ex=n(d-sh) - Gab) + [Sh aga-s5-5t5 5+ 


3 3n° 3 3n2 2) ne? 
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| US ay = In 1,3). So, i Wh ay = s+a-p-4 (3) or, as noo, 


1 
| Lt eee (3). Thus, ¢(3) =3-—3 | — dx. 
1 Xx 1 xX 


(C5.4): Let a=1+x, with x0. Then, ae = 4+ mR or, using the 


power-series expansion for In(1+x) given at the beginning of Sect. 5.2, for 
—1<x< 1, we have 


= lim 


II 
cba 
LB 
i a ee i 
— 
Pat — 
Pal 
| 
Nw > 
+ 
|" 
=n 
| 
| "bo 
aa 


‘ ; 1 ot yi 1 = Lydia 
(C5.5): We start with 2fb-b+d-h4--| — [{e+e+h+ +} 
{z ae z + a +:: ‘by, The two sums in the curly brackets are the sum of the odd 
terms of €(2), and of the even terms of €(2), respectively. Now, consider the sum of 


1 —I1}1 1 
rt ohte =e et 


1 I 1 
(217 (2-2) 


the even terms: ptptetes 


gitgt: | = 4€(2). This means the sum of the odd terms is 3€(2). So, our initial 
expression is 2[3¢(2) — 4€(2)] = ¢(2), as was to be shown. 


‘in (= x) 
(C5.6): In | ———— dx, follow the hint and change variable to 1—x=e‘. 
x 


Thus, a =-—e' or, dx=e ' dt. Now, when x=0 we have t=0, and when 
1 2, oo 2(a-t lore) 2 
In-(1 — 1 t 
x=1 then t=00. So, | we) x =| qe at= | e'dt= 
0 x 0 1 = et 0 1 = et 


love) t2 

| a jt From (5.3.4) we see that this is I'(s)¢(s) for s=3. That is, 
. _ 

Y in?*(1 — 

| MS is 


0 Xx 


= 1(3)6(3) = 2!6(3) = 26(3). 
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co yp 
(C5.7): In (5.3.4) write p=s— 1, and so we have | = “dx =T(p+ 1)C(p+ 1). 
i eS 


1 
Continuing, | ——— dx =| ——— dx. Let u=e™ * and so eX =1. 
9 & -— 1 90 eX(1 —e-*) u 
Also, In(u) = — x or, x = —In(u). Finally, du =-e *=-u,andso dx= — au 
= P ° {—In(u)}? '{-] In(x)}? 
so,| x ax=| t n(u)} ( 2) -| { n(u)}? du. Thus, | {=In(x)}? n(x } 
0 e*(1—e-*) 1 “(1 —u) 7 0 1 0 ~ y-x 
dx =I(p+1)¢(p+1). 


(C5.8): Since t=1+p+p iy m2 then ——1__s— 


1—x 1 X2X3...Xn 


1 pl 
1 
sc ‘ see} ——W—____ dx dxdx3.... dx, = 
Sg Ca a) and so | (— X1dX20x3 X, 


1 fl 1090 1 fl 1 
| | | x (9% vs Ka) dx, dxpdx3... dx, = a | | | ty hs 
0 J0 
1 


0 K=0 0 


1 fl 1 
dx;dx2...dXp. Now, | | | re Cee oa dxdx.. y= | *«" dx, 
0 


0 Jo 
1 1 k+1 k+1 k+1 1 
| rohdne | xndx,= a [ a le eee a lo = a SO, 
0 0 k+1 k+1 k+1 (k+ 1) 


1 : 1 dedecd 4 oe 1 1d 1 1 
see) — dk dx9dx3....dXy = 7= t t 
oJo Jo 1—X1X2X3---Xn ie ai k=0(k+ 1) 7m 2? 3" 4 
+. =C(n). 


(C5.9): In le in( 
0 


dx = —“, Thus, 


[oe] —x 0 1 
| In l+e ax=| m l+u du | Ln l+u du 
0 1-—e™* 1 l-—u u ou l-—u 


l+e™%* 
1— 


=) dx, let u=e * and so “= —u_ which means 


dx 


— 


{In(1 + u) —In(1 —u)}du 
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(C5.10): Following the hint, write I(m)= f[ #°x"e “dx = [ fe" C&e~Xdx. Then, 
al = | In(x)e™"™e-* dx, and so at — | In?(x)e™"™e-* dx. Thus, 
0 0 


dm dm? 


| e* In?(x) dx = 2 |=. Notice that I(m) is the gamma function I'(n) for 
0 


n—l=m, that iss n=m+l1. So, Im)=I(m+1) and | e* In’(x) dx = 
0 


i T(m+ 1 ) b mao. Now, the digamma _ function _ says we) 


di 
di(m+1) _ d(m+1) 
re@|-t-v+ (+- =) and so, for z=m+1, ea eee 


1 ; cae _ @T(m 
T(m + 1) [th ca a he (; = =—=n)| . Differentiating again, £ Pine) 


I 


00 1 
dr(m+1) 1 oe 
dm | mer ye .G aan} +T(m+1) sate Gan ae 


So, since [(1)=1, 


4 eo) tay), 


dr (m+ 1 
=-l-y+l = y and ‘m 2 Mit 0 
=—y}—1- = 1 
Y ee T — ae Se @iiy 
Lea rs ee ee 
a on: a) 13 3 
+1+5 tape =yt+yY-ytlt+5 tat 


2 ine) 
= +C(2) =P+7=| e * In?(x) dx. 
0 


1o.@) —u 


1 = 
J—e 
(C5.11): From (5.4.1), =| 7 du | 2 du. In the second integral, let 
0 u u 


1 
-! 


i 1 ert 0e4 1 let 
t=- and so du= =u. Then, du = i —sdt | = 
" t 1 U lq t 0 


1, eu 1-1 1 1 
du du or, as was to be shown, y= | ——————du. 
o uu o u 0 u 
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Chapter 6 


(C6.1): Follow the same path described in Sect. 6.3. 


x 1 
(C6.2): Following the hint, consider f(x) = a soe 
By direct multiplication, you can confirm that x"— 1=(x — I(x"! +x"-74--- 
+x+1), and so f(x) = wa ct = eH mI = E a | ae —/ {= oy a 


1 
xn_]" 


Next, pick a value for a such that O<a< 1. Then 


j, fax = fr SS Se dx. 


O xn-4 O x2n_4 


In the second integral on the right in the box let y= x and so dy = 2xor, dx = oy 

a 2 a2 2 d a2 d a a d 

and so | a= | = x= | y Thus, | f(x) dx = | z 
9 x7-1 o y2—1 2x 0 y~-1 0 9 xt-1 


9 


av 

d ; 

= | Sea ul i or, as av<a (since a< 1), we can write 
oy 


fF f(x)dx = fe ae 


ayn 4" 


Next, return to the first box and replace the integration limits with b to infinity, 


where b> 1. That is, | f(x) dx =| : | x 
b 


, BH , = dx. In the second 


CO CO d 
integral on the right let y =x? (just as before) and so f(x) dx = . 
g g y 
b 


ody Ee de 2 : : 
because b* > b (because b > 1). Now, in the integral on 


ey i lp Bl 
the right, let y= i and so a = 3 =-y’ of, dx = — a. So, 
b? 1/b? _ay a) ae) 
| a =| = [ z dy =| : = dy and we have 
b 1/b i 1l— y al—- y 


xn -2 


dx . 


ie f(x)dx = rR 
4 


1-x" 


Thus, adding the two results in the second and third boxes, we get 


1 


f f(x) dx + [- f(x) dx = [ os [ ee 


| 
T 
0 b g x2 —1 1 J—x 


b2 
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1 


a d ib n—2 
f(x)dx = | e | “dx. Let b=! (since a<1 
a x" — 1 al a 


10.@) 


or, | f(x) dx + li 


b 
o.@) 


& «dx 
f(x) dx = — 
1 (x) ‘ le xn — ] 


a n—2 aye n-2 a 00 a ee n—-2 
| X dx = | cca ae or, | f(x) dx +| f(x) dx = -| et ae ax: 
0 , 


then b> 1, just as we supposed), and so | f(x) dx +| 
0 


a 


a xX" — 1 a xn—1 a 1—x® 
Our last step is to now let a— 1. Notice that the integrand in the integral on the right 


is a continuous function that always has a finite value, even when x = 1, because of 


jax —(n—2) x3 


L’Hospital’s rule: limy.) F4a- = limy—) —[=5 = Thus, the integral 


1 


f(x) dx + [- f(x) dx = -[ ea Se dx 


always exists. So, as a— 1, we have | i " 
1 1 —Xx 


0 


=0= | f(x) dx and we are done. 
0 


1 oN 


1 1 1 
(C6.3): Following the hint, write | ce’ dx = | (e)* dx = | e™* dx = 
0 0 0 
e*)\) =e 1 = ke” Also, y © ck =y 2 ec which is, of course, simpl 
—h } lo hk ~* > Lk=1 k=1 ’ ’ ply a 


geometric series easily summed using the standard trick (which I’m assuming you 


eo 
1-e*" 


know—if you need a reminder, look in any high school algebra text) to give 


So, 1-e* = = which, with just a bit of elementary algebra becomes e*_ (2+h) 
e+1= f(A) =0. Note, carefully, that while f(0) =0, it is not true that A=0 is a 
solution to the problem. That’s because then c=e~*= 1 and this c obviously fails 
to satisfy f }cX dx => ,c*. Now, observe that f(1) =e? —3e+ 1 =0.23 > 0 and 
that f(5) =e —2.5/e+1=—0.4 <0. So, f(A)=0 for some A in the interval 
, << 1. We can get better and better (that is, narrower and narrower) intervals 
in which this A lies using the simple, easy-to-program ‘binary chop’ method. That 
is, we start by defining two variables, ower and upper, and set them to the initial 
bounds on A of 0.5 and 1, respectively. We then set the variable /ambda to the value 
5(lower + upper). If (lambda) > 0 then set upper = lambda, and if f(lambda) < 
0 then set Jower = lambda. Each time we do this cycle of operations we reduce the 
interval in which the solution A lies by one-half (if, at some point, f(lambda) = 
0 then, of course, we are immediately done). So, running through 100 such 
cycles (done in a flash on a modern computer) we reduce the initial interval, of 
width Ss by a factor of 2'°°, and so both /ower and upper will have converged toward 
each other to squeeze /ambda closer to the solution } by many more than the 
13 decimal digits requested. The result (see the following code cp6.m) is 
i = 0.9308211936517... and so c=e *=0.3942298383683.... The common 
value of the integral and the sum is 0.65079 .... 
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cp6.m 


lower=0.5,;upper=1; 

for loop=1:100 
lambda=(lower+upper)/2; 
term=exp(lambda); 
fHterm’2-(2+lambda)*term+1; 
iff<0 

lower=lambda; 

else 


upper=lambda; 
end 
end 
c=exp(-lambda) 


(C6.4): (a) Taking advantage of the suggestive nature of Leibniz’s differential 
notation that I hinted at in the problem statement, write the differentiation operator 


i= dx d x4 Thus, @ (x?) = =2x%=2[{xt 8. So, replacing the operator x 


4 in the curly hacker vith the ee operator 4 4p we have a (x ee =25 a = 2x. 


Thus, 5 a (x?) =32x=xx and so, starting with Sommerfeld’s equation 


xX + x? = gx, we can rewrite it as ats *) 4x? = gx or, ras *) 42 25? — g or, 
as x? = v’, we arrive at tt oe —2y? + 2g, which is Keiffer’s equation. 


2 


(b) Following the hint, multiply through Keiffer’s equation by x~ to get 


*d7i2, ' 
x? 4(v*) + 2xv? =2gx’. Then, #(x’v) =2gx? or, integrating, | 7 “(x Vy : dx = 
0 dx 


f*2ex'dx and so | a(x?v ae 2gix? =x’v*. Thus, v? =2ox = (sx) and so 


(c) From (b), © = \/3e (4g) & = \/38 (se) 32 ve = 32h =} 
d 2 Ru ° 2 2 
(d) From (b), %&=,/2¢dt and so | <= | dt 3g =T/ = 
(2x'/?)|y = 2VL. Thus, T= 2vE \/3 = ,/%. 


(e) When a length x of the chain (with mass px) has slid over the edge, it is 
moving at speed v = a and so its K.E. is 5px (#)”. The center of mass is 5X below 
the table top and so the P.E. is — HXg5X = —Spgx’. Assuming conservation of energy 
says K.E.+P.E.=0, and so urx (a8)? — Sugx? = Oor, (ye = ES = gx. Thus, & = 


JVgZVx and the acceleration of the chain is By Vg (a5) dx — 
V8(atx) vE VE = 58 
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Chapter 7 


(C7.1): For the n=5 case we have p odd and so use (7.7.2) to write (with p= q=5) 


°° ¢ sin (x))° aN ué in A 
I x } Sao (+1) (24390245) owe 


| ztpau+ | a So, we have A[u?+9][u7 +25] +B[u?+ 1][u? +25] 
0 u?+3 0 u2 +52 

+C[u?+1][u*+9]=u*. Multiplying out, we arrive at A[u’+34u?+225]+ 
B[u* + 26u? +25] +C[u*+ 10u +9] =u‘. Then, equating coefficients of equal 
powers of u on each side of the equality gives us three simultaneous algebraic 


equations for A, B, and C: 


A+B+4+C=1, 
34A + 26B + 10C = 0, 
225A + 25B + 9C = 0. 


This system is easily solved, as follows, using determinants (Cramer’s rule, 
which you can find in any good book on algebra). First, the system determinant is 


1 1 1 
: 26 10 34 10 34 26 
D=j]| 34 26 10] which expands as D = | | = | | | | 
225 25 «9 25 9 225 9 225 25 


= (234 — 250) — (306 — 2, 250) + (850 — 5, 850) = —16 + 1,944 — 5,000 = —3,072. 
Thus, the values of A, B, and C are: 
1 1 1 1 1 1 


0 26 10 26 10 34 0 10 
al 25 91/25 9} _ -16 _ 16 p25 9 9} 
— D ~ —3,072  —3,072 3,072’ 7 D 7 
-| 34 a 
225 9 
_ 1,944 LOM nan St sti 16 , £944 
—3,072 —3,072 3,072 3,072 3,072 
_ 3,072 — 164+ 1,944 5,000 ' 
a 3,072 ~ 3,072 >” 


Nn 


: - 
| sin(x) | 45 |_16 [1 tan-(00) — 22944 ( 1) an=1(00) 4 5200 (1) tan-1(o0) 
ra ie: 3,072\ 1 3,072 \3 3,072 \5 
_x| 80 9,720/1\ , 25,000/1)| _]80—3,240+5,000 
3 [5.07 3,072 \3] ' 3,072 \5 2 3,072 
in 


m | 1,840 920 
= 1 
2 |3,072 3,072 
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or, at last, 


co (sin(x) 5 tills 
i {Re} dx=— 0 


x 


For the n=6 case we have p even and so use (7.7.1) to write (with p=q=6) 


sin (x) ° an a in A 
{ x } ‘Si, @WeD wees) Lp wea 


| ca + | ace and so 

0 u2 + 16 0 u2 + 36 
A[u? + 16][u? + 36] + B[u? + 4][u? + 36] + C[u? + 4][u? + 16] =u" and therefore 
A{u’+52u” +576] + B[ut + 40u’ + 144] + C[u* + 20u? + 64] =u’ and so 


A+B+4+C=$1, 
52A + 40B + 20C = 0, 
576A + 144B + 64C = 0. 


1 1 1 
The system determinant is D=]52 40 20) = —7,680, and so 
576 144 64 
1 1 1 1 1 1 
0 40 20 52 40 0O 
A= 0 144 64 z 320 C= 576 144 0 _ 1,202 Per ae, ee eee 
D 7,680 D 7,680 


8,192 ©  sin(x)}° 320 /1\. 8,192 
BC ee ith SEY. deel te - 
- 7,680 0” \ { x \ . 6| asa) an” (0) — 7 680 


1 1 2/1 
(3) tan-! (oo) + 532 (3) tan “(e)| and so, after just a bit of trivial (but 


7,680 \6 
tedious) arithmetic, 


Peer dx =—1 
0 


x 40 


For the n=7 case we are back to p odd and so back to (7.7.2) with p=q =7, 
which says 


°° J sin (x) ‘ _ 7m uo 
| x al. (u2 i) (u? a) (u? 5) (u? 7) as 


=7 5 du 4 7 du 4 7 du 4 5 5 du 
0 w+ 9 w+3 0 w+5 9 u°-+7 


Solutions to the Challenge Problems 393 


and so now you see we are going to be working with 4 x 4 determinants which is 
starting to be really tedious and so I'll let you grind through the routine arithmetic to 
arrive at 


‘ 7 
co =e} d 5,887 
—= x=——__T 
Jo { 23,040 


x 


This is equal to 0.8027151..., and MATLAB agrees as quad(@(x)(sin(x)./x). 
47,0,100) = 0.802710. . .. 


10.6) 10.6) 


(C7.2): To start, write | edt = | cos (t”)dt + | sin (t”)dt = C(x) + iS(x). 


JX 


Then, | eat =| cos (t”) dt _ | 


x x x 


xX 


1o@) 10.0) 


sin (t°)dt = C(x) — iS(x) = | edu. 


xX 


(Remember, t and u are dummy variables.) So, {C(x) + iS(x)}{C(x) — iS(x)} = 


| e| edu and so C?(x) + $*(x) = | | el?) dt du = 
| | cos (7 _ u’)dt du + | | sin (1° _ u’) dt du. Since C(x) + S?(x) is 
purely real then its imaginary part must vanish, that is, [2° 2° sin(t” — u*)dt du=0 
for any x and we are done. 


(C7.3): To start, write 1 — ix? = V/1 + xe” where 0 puts this complex vector in the 
fourth quadrant if x >0 and in the first quadrant if x <0. Since le’’l=1 for any 0 
then the specific value of 8 doesn’t actually matter when we calculate the absolute 


3 6 1 1 1 1 
value of 1—ix” as V¥1+ x°. Thus, Feel [=i] = Jie = Gay? and so 
| 1 i Th [ dx e [- dx af dx 
Ale | Gaal us, oa Steg hee 7 
ioe) eas -co V1 — ix? © Sooo (1+ x6)# o (1+ x) 


because the integrand in the middle integral is even. Now, 


oo dx tds co dx ; tix 
| =| + ———1 Since | ———, = M, where M 
o (1+x%* Jo (14+ x®)# Ji (14+ x6) o (1 +x) 
is some finite number because the integrand is finite over the entire interval 
of integration, and noticing that 1+x°>x° we can write 


co dx %° dx . °° dx 1/2 |o0 
7<M4 a" And_ since aa = (—2x / jin =2, then 
0 (1 + x9)4 1 xX 1 Xx 


oe d y d 
| a <M-+ 2 and so | ee exists. 


~o V1—ix3 —o V1 — ix3 
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k 

(C7.4): Start with | 
1 


dx c-1 fit) dx k 
ea Dont |p Can) =A(1 8) Then, 


k itl 
n dx n k-1 [J dx n | 1 1 
Pied | <n ye Ie | <n pe 5(1 2) = 5 S(n)) 


n 


1 : 2 ss 
where S(n) = a ie (Remember, lim,_,.. S(n) = ©.) Writing out the double 


summation, term-by-term just as we did in (C5.2), and then doing the ‘adding 
vertically’ trick, you should now be able to show that $ —4S(n) = 


" {x} 


Boe toe ag gst | OF dx. That is, 

1 x i 
| UF dx = 1—48(n) ~L and so, leting n—o0 we have | WS gx = 1-4 
il, oe = 


S(co) or, at last, 


oe ee 
f = dx=1 ce 


ex 


OO: eed 
sin “(ax : ‘ ; 
me) dx, differentiate with respect to the 


(C7.5): Starting with I(a) =| 
x 


0 
eereee a = i ao cos (ax) fo i 2 sin (ax) cos (ax) ae 
Xx 0 Xx 
Recalling the identity sin (ax) cos (ax) = 5sin(2ax), we have 
lo.<) 7 ip} 
i = | me) dx = +5 from (3.2.1), where the sign on the right depends on 
0 x 


the sign of a (+ if a>0 and — if a<0). Then doing the indefinite integral, far = 


| $da + Cor, I(a) = +$a+ C where C is an arbitrary constant. Since I(0) = 0 we 


know that C = 0 and so 


foe} 


I(a) = f, 


oun) ieee lal . 
x 2 


(C7.6): If you set b= 1 and k = 2 in (4.3.10) and (4.3.11) then the Fresnel integrals 
follow immediately. 


(C7.7): Following the hint, the Fourier transform of f(t) is (I’ll let you fill-in the 


_ ‘in(me) and so |F(@)|* = 


cos (ma@)+ie7™ 


_ l-e 
= atio 


easy integration details) F(o) 
. The time integral for the energy of f(t) is | f?(t)dt = 


—oo 


1+e72™_—2e-™ cos (mo) 
PY} 
@* ar 
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10.6) 


e dt = 1 while the frequency integral for the energy is | 


—oo 


FOP go — 2 [- 1 + 72 — 2e-™ cos (mw) 
on Qn} oa 
and then doing some easy algebra (where I’ve also changed the dummy variable 
fj ‘ont ; °° cos (mx) 
of integration from @ to x), gives i” ie 
as (3.1.7), where in that result I wrote b in place of m, and the integration interval 
(of an even integrand) is 0 to oo rather than — oo to oo (thus accounting for the 2 on 
the right in (3.1.7)). 


dw. Equating these two integrals, 


dx = Fe ™. You'll recognize this 


; ee cos (wt) [°° — sin (ot) . 
(C7.8): (a) \_ a ic dt = ie | dt —i es dt. The last inte- 
on eS t 
gral is zero because the integrand is odd. Now, | e dt = 2 conten 
oo +1 ?41 


and the last integral is, with b=1 and a=w@ in (3.1.7), equal to ze. So, for 
@ > 0 the transform is x e °. Since the time signal is even, we have a purely real 
transform and we know that is even. So, for @ < 0 the transform is x e °. Thus, for 
1 
all @, 2 7 
(b) Since the Fourier transform of f(t) is F(o)=[® fe “dt, then 


oe nell , 


oo 


-| —~itf(t)e "dt. Thus, [ wecjea = 1d — 748 So, if f(t) Fo) 


then tf(t)  i4£. Now, as shown in (a), for @ > 0 the transform of 


and so the transform of x is i a 
we have a purely imaginary transform which we know is odd. That is, for @ < 0 the 


t 
+1 


. l af io is —iw i 
(c) i- {58 + isape ‘a=H] (de ate | ; 
the first integral on the right is 1. And from (7.9.3) we have 


1 
e+1 
(xe~®) = —ine~®. Since the time function is odd 


iste °, 


transform must be ize °. So, for all @ we write «+ —ine!| sen(o). 


lee) —iot 


dt. From (7.9.14) 


ioe) —iat 
| 2 ; dt = insgn(—@). So, the transform is $+ [insgn(—@)] = 3—4sgn(—o). 


2 ioe) 
Since sgn(x)=+1 if x>0O and —1 if x<0O, then the transform is 
5—3(-1) =34+5=1 if @>0 and $—3(+1)=}—-4=0 if w<0. But this is just 
u(@), the step function in the @-domain. So, 


(d) Following the hint, let x={ and so xt=u and du=t dx. Thus, 


00 @-u OO @oxt co eW Xt 
E;(t) = du = t dx = dx, t > 0 and zero otherwise. So, 
r ou 1 Xt i * 


the Fourier transform is 
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00 —xt ; oO | ; oO] —(x+io)t = 
| | dx se dt = | — fertronat dx = | - a 9 dx 
0 1 # 1 X) —(x + io) 
1 0 
a 1 1f° {1 1 
= | — dx = - | —] dx 
1 X(x + i@) iaJ,; \x x+io 
— =] _| ‘ lo) 
=| n(x) — In(x + io) ||; 
1 00 1 1 In(1 +i 
=—In = | = ——In - su a) 
io \x+io]'! io \1l+io iw 


oo ee : 
That is, | dyes 2, 
u 


t 
(C7.9): The second Hilbert transform integral in (7.10.11) is 2X(@) = 
eK e OR oR 
| (u) du = | (u) du | (u) du. If, in the first integral on the 
@—uU 9 @—-U 9 @-Uu 
right of the equals sign, we make the change of variable s = — u, we have rX(@) = 


[ ne); ds) \- RO ay = (when x(t) isreal) |. is) ds i 5) du = 


0 = O+S @—u 


—oo 


= 1 1 2 
-| TO + lou - | R(u) G5 du and so, when x(t) is real, 


(C7.10): By Rayleigh’s theorem the energy of x(t) is | |[X(w)|°dw and, since the 


energy is given as finite, we have (A) bee |X(w)|7do < oo. Also, since y(t) = x(t) * 
h(t) we have Y(w) = X(@)H(@). (See note 14 again in Chap. 7.) Thus, |Y(@)| = 
|X(w)H(@)| = [X(@)||H(@)| and so |¥(@)|* = |X(@)|"|H(@)|*. From this we conclude 


10.6) 10.6) 


(B), | Y(o)Paw = 5] |X(@)|"|H(@) |"do. Finally, H(@) = f © h(t)e™ dt 


and so |H(@)l=| f° h(te dt] < f% |h(te” ‘'|dt. (See the hint in Challenge 
Problem C7.3.) Continuing, |H(@)| < f%,|h(t)|le‘“'|dt= f°. |h(p|dt because 
le “| =1. This last integral is given to us as finite, and so |H(@)| <«, that is 
|H(@)|? <0. This means |H(@)|? has a maximum value, which we’ll call M. 


Putting that into (B) we have 4 IY(o)Paw < 2 [X(w)|7M do = 


| |X()|? dw. From (A) we know that this last integral is finite, and so 


| lY(w) "dw < oo. But this integral is the energy of y(t), and so the energy 


—oo 


of y(t) is finite. 
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°° cos (wot 


_ oo elot =o e mot 
C7.11): F >0, x(t) = du. 
( ): For o x (t) yo | s| a u 
a 00 im (t—s) 
Let s=t—u, du=-—ds. Then x(t) = | : ; (ds) + $ 


lore) eiwo(t-s) ian [% e ios “sont [% ios 

| [——@s) == | ds +*> | ds. From (7.9.3) we 
“66 S eee: S 

ln) i@os 


——ds = insgn(@9) = in because 
s 


1o.@) eat 
have | dw = insgn(t), and so | 
oo @ 66 . 
00 g—iwos 


@o > 0 and sgn(positive argument) =+1. Also, | ds = insgn(—@o) = —in 


because @®)>0 and_ sgn(negative argument)=-l. So, x(t) = 
H[—ime!' + ine") = 52 [et — e'] = ®2isin (Wot) = sin(wot), the Hilbert 
transform of cos(@ot). If you re-do all this for the Hilbert transform of sin(wot), 
you should find that it is — cos(@ot). 


Chapter 8 


(C8.1): Since f(z) = g(z)(z — Zo)™ then —~dz= 


m—1 : m : 
frdineaal tee we f Be 4 {82 en—n 
Cc g(z)(z — zo) cZ— Zo c g(Z) 
dz g (z) dees 
+ dz. Now, the first integral is 2mi by (8.7.1), and the second 
cZ— Zo c g(z) 
integral is zero by (8.6.1) because g(z) is analytic which means g’(z) is analytic and 


so = ue is analytic with no zeros inside C (by the given statement of the problem). 


f 
Thus, ¢ na) 4, = 2ni m and we are done. 
c 


f(z) 
(C8.2): Since we are going to work with f(z) = a we see that we have three 
first-order singularities to consider: z=0, z=—ia, and z=ia. This suggests the 


contour C shown in Fig. C8, where eventually we'll let e— 0 and R— oo. The 
first two singularities will always be outside of C, while the third one will, as 
R— om, be inside C (remember, a > 0). 
Now, tte dz = [+| +| +| On C, and C3 we have z=x and dz=dx. 
C 


Cc C2 C3 C4 


—€ elmx R eimx 
Thus, | +| -| a+ | eo or, as e—0 and R-««w, 
c, Jc, Jer x(x? +a?) a RP a") 


| + -| ee On Cs we have z=ee",-1<0<0, dz = iee'd0. 
a Jc agg R(X" 2") 
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Fig. C8 The contour for wid 
Challenge Problem C8.2 


Ca. 


; i0 
e/mee Tv dé 1 


0 
= oa l0 = . . 
Thus, I. =| ee®(e2e2 4 a2) dé or, aS E— 0, I i a2 = Los 
On Cy, we have z=Re®, 0<@<zx, and dz=iRe”’d0. Thus, 


x imRe” x imRe® 
e ; @ 

i iRe®d@ = i] ———d0. The absolute value of the 
le I Re? (Re + a?) | R020 + 92 


integrand behaves, as R — on, like ra because the absolute value of the numerator 
is 1 for all R and 0. Thus, as R— oo the integral behaves as 3 which goes to 


oo elmx r 

zero as R= oo. Thus, -_ 5 5 dx —i om But we know that fc= 2ni 
Cop XOP Fa) a 

(residue of singularity at z=ia). That residue is lim,_.ia (Z — ia) 

; ne) eimx 
eimz _ eimia _ e7ma Te P e7ma _ +qe7ma 
z(z—ia)(z+ia) ~ ia(2ia) ~— 2a * So, [. xx + a) dx ay 2ni( 2a ) ennai Oe 
lo) elmx 
— 9 te Ne Tt, —ma ‘ ’ 
And thus, \_ ee = i5-i®s-=i5(1—e™). Using Euler’s 


identity on the numerator of the integrand, 


x=135(1—e-™). Equating real parts of this last equation we 


oo X(x* +a?) 
°° cos (mx) ae eck 3 ; 
ge =n dx = 0, which is no surprise since the integrand is odd. More 
oo KX? $a?) 
interesting is the result from equating imaginary parts: 


es Pe ah? 
| sin (mx) dx =~ (1—e ™*) or, since | = 5| , we have 
moo X(X? +a?) a? : 
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ihe sin(mx) ae T (- -e7 —), 


O x(x? +a?) 2 a? 


which earlier we simply assumed. 


(C8.3): (a) Writing z=e" (and so dO = %) on the unit circle C, we have 


cos (0) =“#". Now, consider ¢cf(z)dz with f(z) = ers ee Then 


2m 

de d ; d 
| =f = (22) =if There 
9 1 —2acos(0) +a cl—2a2 +2" + a2 cw —#tlz 41 


ry 
atti 241)" _4 
a a 


are two first-order singularities at z = i which, after a bit of algebra, 


reduces to z=a and z = 1, Since 0<a< 1, the first is inside C and the second is 


‘ dz : 
outside C. So, ¢ Sy = 2m (residue at z= a). From (8.8.9) that residue 
cz —*tz+1 
a 
2n 
i 1 1 1 a dO 
- om = 2 = =7—wmre OW, a 
a(2— tly +1) | (22— e+) |. a (2a— cae) a2—1 |: 2a cos (0)+a' 
0 
2n 
i “a __ Qn —1 dé — 2n _ 8a 
g2Ni oy = 7 O<a< 1. If a=3, for example, we have | ;—S 9 = 74 =3 
4 ( ) 4 
0 


= 8.37758... and MATLAB agrees because quad(@(x)/./U1.25-cos(x)),0,2*pi) = 
8.37758. ... 


(b) Let f(z) = —“>—, that is consider the contour integral ¢ ——,—_dz 
(z) (za)? +b? 8 c(z+ a)’ +b 


where C is shown in Fig. 8.7.1. The integrand has two singularities (are each first- 
order), at z=—axtib. Since a and b are both positive, only the z=—a+tib 


IZ 


singularity is inside C. Thus, ¢ dz = 2ni (residue at z=—at+ib). 


c(z+a) +b? 
On the real axis z = x, dz = dx, and on the semi-circular arc z = Te”, dz= iTed0, 
0<@O0<zx. So, on the’ semi-circular arc we _ have the integral 


T iTe® 
| —_____,__jTe'*d®. The absolute value of the numerator is T for all 
iO 2 2 
0 (Te® +a) +b 
6 and, as T— oo, the absolute value of the denominator behaves like za 


iz 


So, the integral behaves as 14; = $ — 0 as T-> 00. Thus, ¢ <r = 
c(z+a)' +b 
. Fe ex Tove) ex 
lim —.— 5 Ax = 2ni (residue at z= — a+ib) = Za? 
T-00 _t (x +a) +b —0oo (x +a) +b 


Now, the residue at z=—atib is given by lim 2Z—(-a tid) 
zZ——atl 
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CO 
elZ gia +b) gia gb ee cos (a)—i ce? sin (a) 
[z—(—atib)|[z—(—a—ib)] — —atibtatib 2b 72b and so 
—oco 
ie 
ar dx = 2ni eee . Expanding the numerator of the integral 
xa 


with Euler’s identity and equating real parts, we get 

| a cos (x) 
Lee eed 
a sin (x) ie 

| 7 k= e ’sin(a). If a=1 and b=1, for example these 
—co (x+a)*+b b 

two integrals are equal to 0.6244... and — 0.97251. .., respectively, and MATLAB 

agrees since quad(@(x)cos(x)./((x+ 1).42 + 1),-1000,1000) = 0.6245... and quad 

(@(x)sin(x)./(x + 1).42 + 1),-1000,1000) = — 0.9697. ... 


dx =§ e->cos(a), while equating imaginary parts gives 


iz 


(c) Let f(z) = ra) (Fab) ” that is consider the contour integral 
eZ 
dz where C is shown in Fig. 8.7.1. The integrand has four 
f (22 + a2) (z2 +b’) = 
first-order singularities at z=-+ia and at z=+ 1b, but since a and b are positive 


eZ 
only z=+ia and z= + ib are inside C. So, 
. f (22 + a?)(z? + b’) 


at z=+ia plus residue at z= + ib). Those residues are: at z= + ia, lim, .j, (z — ia) 


dz = 2mi (residue 


eZ i(ia) —a —a " 
Fae DG) mamta) Tae En — once ey’ and at z=+ib, 
‘ ‘ iz i(id) —b 
lim,» (2 — ib) GagayGcyaE) = Tela) GbHaab = SDbe—ayera) = =e zy’ 


On the semi-circular arc z = Te? dz= iTe’d0, 0 <0 <r, and so that integral is 


\; Fae (Feb) iTed0 which, as T > oo, behaves liken & — 0. So, all that we 
0 
h 


ave left is the portion of C that lies along the real axis, which says that 


loo) ex —a —b 
a ax = 2ni | i—— — 
Joo (x? + a?) (x? + b*) 2a(a2—b?) '  2b(b? — a?) 
= —2n am =f = 
= 2a(a2—b*) 2b(b? — a?) 
7 e> e* 


b(a? — b’) a(a? — b’) 


_ ae cos(x) og. 


~oo (x2 + a2) (x? + b”) 


sin (x) 


FI dx. 
| (x2 + a2) (x? + b’) 
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in cos (x) di at 
—oo (x? + a2) (x? + b’) (2?-b*) 
[¢ 2]. If a=2 and b=1 this reduces to "75" = 0.31438... and MATLAB 
agrees: quad(@(x)cos(x).M((x.A2 + 1).*(x.A2 + 4))-1000,1000) = 0.31436... 


az 
e 


Equating real parts gives us our answer: | 


(d) Let f(z) = Se, that is consider the contour integral : —————dz 
(2?+b’) Cc (2? + b?)” 
where C is shown in Fig. 8.7.1. The integrand has two second-order singularities at 


iaz 
e 


z= ib and, since b is positive, only z= + ib is inside C. So, ¢ 7 dz = 
c (22 +b’) 
2ni (residue at z=ib). We calculate that residue as follows, from (8.8.8), using 


Nd jaz d eltz (z+ib)? ie 
m=2: lim z— ib fs = { } = = 
ima Y enrf 8 eras bee = Gay bea 


which reduces (after just a bit of algebra) to —i aoe Thus, 


eltz 
Od j Atab —ab) _ a —ab a 
¢ em ey dz = 2ni(—i we ) su (1 + ab)e™®. On the semi-circular arc 


‘ i iaTe!® i i 
z=Te”®, dz=iTe’d0, 0<@<n, and so the integrand is Gamay te with 
2 9i20 4. 2 
an absolute value that behaves as a= a as T— oo. The integral therefore 


behaves as a which vanishes as T— oo. Thus, since on the real axis z=x we 


loa) iax 
e 


have in the limit of T— oo that | + dx = 5%;(1 + ab)e~*. Equating 
—oo (x? + b’) 
real parts (after using Euler’s identity in the numerator of the integrand) gives us 
cos (ax) eh : ane lis 
(1+ ab)e~* or, since} =; because the 
0 


—0oo 


dx == 


1o.@) 
the result: | a 


-oo (x? +b)” 
°° cos (ax) 

=, (1+ ab)e. 
0 (+ b?)” - 
If a=b=1 this equals % = 0.57786... and MATLAB agrees: quad(@(x)cos(x)./ 
((x.42 + 1).42),0,1000) = 0.57786. . .. 


integrand is even, we have our result: | 


oo k 
(C8.4): In the integral | —_— dx, the integrand, for large x, behaves like 
0 (x?+1) 
= = Ek: For the integral not to blow-up as x co we must have the exponent 
4—k>1o0r3>kor,k <3. For small x the integrand behaves like xk = s. For the 
integral not to blow-up as x — 0 we must have the exponent —k < | ork > — 1 or, 
—1<k. Thus, —1<k<3. Now, following the hint, let’s consider the integral 


¢ cf(z)dz where C is the contour in Fig. 8.9.1 and f(z) = ear 


has two second-order singularities, at z= + 1, and both will be inside C as we let 
R— o and both ¢ and p> 0. On Cp, z= Re® and dz = iRe’°d@ and we see that the 


absolute value of the integrand behaves as a as R > oo. That is, the integral on C 


This integrand 
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will vanish as R > 00. On Cy, z= pe” and dz = ipe’’d0 and we see that the absolute 
value of the integrand behaves as p as p — 0. That is, the integral on C, will vanish 


as p — 0. So, all we have left to calculate is + On C;, z= re” and dz= e“dr, 
Cc; C3 


R ekin(re) ; 
—.—. 90" dr 

p (r2e!2e +4 1) 

R ekin(r) 


—, dr 
p (1? +1) 


and on C3, z=rel?*—® and dz=e'?"~ dr. So, | + -| 
Cc; C3 


i’ ekin{ re'?x-9) } 


R (r2ei2(2n—e) lt 1) 
p ek{In(r)+i22} 

+| ———r. If we now let p — 0 and R > oo, we have 
g. (ed) 


oo gin(rk) oo ,in(rk) +i2nk 00 yk __ pk gi2ak 
[+f =[ Sve [ar [ae 
c Jo, Jo (r?+1) o (17 +1) 0 (17 +1) 


seil™-®) dr or, as we let e—0, | + -| 
Ci C3 


oo yk [1 _ ef?ak] 00 pk ink [e~™ = eink] 
Petal = Peele, 
0 (r?4+1) 0 (r?2 + 1) 
[° re!k 23 sin (xk)| 4 
a r 
0 (12 +1) 


0° 1k ,ink —2isi k 
Now, f tteaz = | ia ae ) dr = 2ni(residue atz = —i plus 
Cc 0 (r2 + 1) 


residue at z = +i). Sincef(z) = x, and since for a second-order singularity 


zk 
(z+i)"(z—i) 


at Z=Zg we have from (8.8.8) that the residue is lim,_,,, a {( - 20)°#(2)\, then 


for z= —i, the residue is Ry where R, = lim f(z +i) ial = lim 4 

HL ye (zi)? kak! 2k2(2-1) (= 23)? k(= i) '~(—i)k2(—21) _ —4k(— 1 4 (—)K4i 
ert —-) oa ae Cay a 6 ne 
Ry = sa If you repeat this for the other residue, R>, you’ll find that 
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Thus, 27i(R; + R2) = —$(1 —k) [\ i)s (i and so 


00 rx ink —~2i si k 
| e!™| pene )] eat (1 —k) [ i) (i 
0 (r2 + 1) 2 
or, 
a Ne Ho [(a® <i - 7 
| adr = a pe ( : mu | Since —i = e’? and = e”2, we have 
5 (r2 + 1) isin (tk)e 


Ea SG ik _ git — elo) = elle) | = ett ef(#) _ eI 


= e™*2j sin (F) 
2 


2 rk n(1—k)e'™*2i sin (2 n(1— sin ( . ; 
Thus, | (+ ne = 3 athe oe = = *) {3 ae Or, since sin (xk) = 


2 sin (2) cos (#), and changing the dummy variable of integration from r to x, we 


0° k 
arrive at| —— dx = ue) ,—1<k<3.MATLAB agrees, as ifk = 5 then 
0 (x2 + 1) 4cos (¥) 


d 3 a x 0.55536..., and d rt(x)./(x.42 
| (x2 +1) aS Beds @) 85” 8 and quad(@ (x)sqrt(x)./(x 


+ 1).42,0,1000) = 0.55535. .., while if k = 5 then 


= 0.60459..., 


I, ll dx = 3 SNe ame 
0 (+1) 4cos(§) 638 3Vv3 


and quad(@(x)(x.A(1/3))./(x.42 + 1).42,0,1000) = 0.60459. . .. 
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(C8.5): Consider ¢ cf(z)dz, where f(z) = eo where m > 0, b? > 4ac, and C is 
the contour in Fig. 8.6.2. As in the derivation of (8.6.5), there are two singularities 
on the real axis, at x; and Xo, as shown in Fig. 8.6.2. The values of x; and x2 are as 
given in the text. The analysis here goes through just as in the text, taking into 
account the change in f(z). That is, the three integrals along C,, C3, and Cs will 
combine (as we let e — 0 and T— oc) to give us the integral we are after, and its 


value will be — [tea + [reac + | tea . So, let’s calculate each of these 


on Ca Co 
three line integrals. For C>, 


0 im(xo+ee") + a10 
| f(z)dz = | E es do 


> x a(Xp + ee!)” + b(xp + ee) + 
[ eix2 gimee” jn ef 


x A(X? + 2x,E0e + £%e/20) + oe +ee)+¢ 


dé 


dd. 


[ elm eimee? j ei? 


x (aX22 + bx. +c) + axel + ae2e/28 4 bee’) 


c 2 : 7 2: 
Since ax» + bx. +c =0 because x> is a zero of the denominator, and as e~ — 0 


faster than e—0, then for ‘small’ e we have im | f(z)dz = 


e—0 
2 


10) e'MX2 je elo 0 elma 
lim ee =1 dé =-—nxi-.. In the same wa 
x 2axye0!® + bee’® , 2aX2 +b TU Fax5 4b y; 


imx 


ig te = —niz5 Also, as before, lim | #az=0. Thus, 


Co 
°° cos(mx)+isin(mx) ~ of gimy itty 
co ax? + bx +¢ Laas a NOWy 
2ax, + b = Vb* — 4ac and 2ax, + b = —Vb? — 4ac and = so 
°° cos (mx) + isin (mx lim eimxy . : 
| ( z) isin (mx) dx = ni|-5 : |= i—4+— (e’™! — e'™2) 
aS ax* + bx +c Vb 4ac Ve —4ac Ve —4ac 


= i———| cos (mx, ) + isin (mx,) — cos (mx) — isin (mx or, equating real 
Ez [eos (mx) + isin (mxi) ~ cos (mxx) — isin (mx2)] or, equating 


| °° cos (mx) 
oo aX? + bx +c 

[sin (mx2) — sin (mx;)]. Using the trigonometric identity 
/b’—4ac 


sin(A) — sin(B) = 2cos (448) sin (458), we have 


parts on each side of the — equality, 
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[- cos (mx) mx, + mx; ) . ae - =) 
= —__—_—— _) sin (——~_——_ 


4 
Pelee ( 
oo aX? +bx +c . =| a 2 2 
2n mb . fm 1 5) 
ale)“ C-=}) 
2n (=) . ee *)| 
= — —______ | cos | —— } sin | ————__ ] } . 


2a 


(C8.6): Following the hint and using Fig. 8.9.1, there are two first-order singular- 


ities inside C (as we let e > 0, p 0, and R > ov), one at z= — 1 =e” and one at 
Z=—2=2e". The residue of a first-order singularity at z=zp in the integrand 
: — g(2) +. g(Z0) _ z = = 
function f(z) = nz) 8 naa)" For f(z) = rij aay WE have g(z) = z? and h(z) = (z+ 1) 
(z+2) and so h(z)=(z+1)+(z+2)=2z+3. Thus, the residue at —1 is 
ay as = Sos = e*, and the residue at — 2 is fo = Beh = —2PelP*, Thus, 


2ni times the sum of the residues is 2mi(e’?”—2Pe'P") = 2nie'P"(1 — 2°). So, 


; R (re*)? : 
| + + +| = 2nie'P™(1 — 2). Now, | -| = = e€dr and 
Ci JC, JC3 JCy Cc p (re + 1) (re + 2) 


p (rei(2"—e) \P jie 
| = | (rel) fa Drees 7 7° dr and so, as e — 0, p > 0, and R— ~, 


C3 
lore) p ee) Pai2px oO yP(] — i2pr 
| +| -| 7 dr | — ar=| ee ie Next, 
c Jeo: Jo @+1)0+2) o (r+1)(r+2) o (t+1)(t+2) 
2n—€ (Re®)? " ; 
= 5 7 iRe'’d0. Since as R--oo the numerator of the 
c Je (Re +1)(Re® +2) 


integrand blows-up like R’*! for any 0 in the integration interval, while the 


denominator blows-up like R, then the integrand behaves like = RS ai 


T-p- 


The C, integral thus behaves like a For p<l, | —0 as R-oo. Also, 


Cy 
: (pe) 0 
| =| 5 5 ipe d8. Now, as p—0 the numerator behaves like 
C, Jane (pe? + 1) (pe? + 2) 
p’*! while the denominator behaves like 2. So, the integral behaves like x p?*! 
which clearly 0 as p—0 as long as p>—1. So, we have | +| =0 which 
Co JCy 
oO PY — i2pn ; 
means | + =| so dr = 2nie'P™(1 — 2°) or, 
ca Je; Jo +1)(+2) 
a xP ipe(1 — QP) elP™(1 — 2P) 
xy _ 9 t ( _ oe: 
| (x + 1)(x + 2) = 2ni 1— e/2pr = 2ni e!Pr( e7ipm — e!Pt) 


1 — 2? 2P—1 
~ oni! — aug ) l<p<l. 
—2i sin (px) sin (px) 
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elz 


(C8.7): Following the hint, we’ll use the contour in Fig. 8.6.1 to compute @ —dz 
c Z 


-| + + + =0 because C keeps the lone singularity of the integrand 
Cc; Co C3 C4 


e nelly) 


T .<* 5 i0 
tf we i e ee ene 
(at the origin) in its exterior. So, | — ax + | et iTe%eo + | 
e X 0 T 


0 ect” 
[¢ = ieedd = 0. That 1S, 


5 


T we* 5 tel T .e°% 5 
[ < © dx + if e ™" 40 = | dy — if ee "d0 = = 0. In the last integral, as we 
& 0 y 


€ 


iee!® . . * iTe/9 
let e—0, e© —e and so the integral is Fe. In the second integral, e° = = 


iTcos(0 } 
=e = A es J and so as T— oo the integrand goes to 


iT [cos (0)+i sin (0)] iTcos(0)— Tsin(0) 
rm = 
e°=1 and so. the integral is - Thus, as e—0O and Tow, 


e€ 


=y 


| dx +i§— | <_ dy —i%e = 0. So, 
x y 


0 0 
OO cos (x)+/sin (x) OO ge ~Y 
| = dx | : dy =ixe eae 1) 
0 x 0 Y 2 2 
or, 
00 cos (x) gi sin (x) oo ge 7Y 
{ — &x— | ay =i5(e-1) 
0 x 0 Y 
or, 
[- e°°S(X) cos { sin (x)} + isin { sin (x)}] ax i" ee” Casey & 
0 x o Yy 
OO ,c0s(x) 3 
equating imaginary parts, we have Cauchy’s result: | caudal dx = 
0 aS 
$(e— 1). 
(C8.8): Following the hint, writ [- - d [ Zs d 
8): Following the hint, write x= —>+—~_ dx 
: —oo (x? + a2) (x? + b’) oo X? + a? 


7 : x _[” axctav’4px24 Ba 
+[ = ome 2k dx and so | =e dx = [agama dx. This 


means that A+B =1 and Ab? + Ba” =0. These two equations are easily solved to 


B=-— 


. _ a 
give A= 2b? 


be S 2 x dps a2 e 1 4 
ero} etary) 8?) eee 


OO 
aia | atarax = sp (hea) 31%, — a fea OH, = wtp 
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oe) x2 


dx = 


407 


—b 7, 2 
ppt = ab Now, let b — a. Then, \_ G4 ay 


3° Finally, differentiating 


2n 


with respect to a, ri 
—oo (x? + a?) 


( —2x"(x? + a*)2a 4 


os a Tu 
X=—qs=—37, Thus, 


love) 2 
| es dx = g3. For a=1 this is 0.392699. .., and quad(@(x)(x.42)./(x. 


~oo (x? +. a2)? 
A2 + 1).43),-100,100) = 0.392699. ... 
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